-- Logs begin at Wed 2022-08-17 18:52:14 UTC, end at Wed 2022-08-17 20:38:57 UTC. -- Aug 17 19:58:48.857368 dv-cinder-820027-19-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 19:58:48.866059 dv-cinder-820027-19-smb devstack@keystone.service[81906]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:58:48 2022] *** Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: nodename: dv-cinder-820027-19-smb Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: machine: x86_64 Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: clock source: unix Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: pcre jit disabled Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: detected number of CPU cores: 4 Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: current working directory: / Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:58:48.868135 dv-cinder-820027-19-smb devstack@keystone.service[81906]: your processes number limit is 47680 Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: your memory page size is 4096 bytes Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: detected max file descriptor number: 2048 Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: lock engine: pthread robust mutexes Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: thunder lock: enabled Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 19:58:48.868724 dv-cinder-820027-19-smb devstack@keystone.service[81906]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:58:48.909975 dv-cinder-820027-19-smb devstack@keystone.service[81906]: Python main interpreter initialized at 0x55a7c3fdf9c0 Aug 17 19:58:48.909975 dv-cinder-820027-19-smb devstack@keystone.service[81906]: python threads support enabled Aug 17 19:58:48.909975 dv-cinder-820027-19-smb devstack@keystone.service[81906]: your server socket listen backlog is limited to 100 connections Aug 17 19:58:48.909975 dv-cinder-820027-19-smb devstack@keystone.service[81906]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:58:48.910405 dv-cinder-820027-19-smb devstack@keystone.service[81906]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:58:48.910405 dv-cinder-820027-19-smb devstack@keystone.service[81906]: *** Operational MODE: preforking *** Aug 17 19:58:48.910729 dv-cinder-820027-19-smb devstack@keystone.service[81906]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:58:48.910729 dv-cinder-820027-19-smb devstack@keystone.service[81906]: spawned uWSGI master process (pid: 81906) Aug 17 19:58:48.910948 dv-cinder-820027-19-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 19:58:48.912096 dv-cinder-820027-19-smb devstack@keystone.service[81906]: spawned uWSGI worker 1 (pid: 81920, cores: 1) Aug 17 19:58:48.912096 dv-cinder-820027-19-smb devstack@keystone.service[81906]: spawned uWSGI worker 2 (pid: 81921, cores: 1) Aug 17 19:58:48.912096 dv-cinder-820027-19-smb devstack@keystone.service[81906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:58:53.443142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:53.443142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: from cryptography.utils import int_from_bytes Aug 17 19:58:53.443930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:53.443930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: from cryptography.utils import int_from_bytes Aug 17 19:58:53.444341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:53.444341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: from cryptography.utils import int_from_bytes Aug 17 19:58:53.444460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:58:53.444460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: from cryptography.utils import int_from_bytes Aug 17 19:58:53.530061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:58:53.530231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:58:53.530321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:58:53.530414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:58:53.530569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] command line args: [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:58:53.530654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] command line args: [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:58:53.530997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:58:53.531083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:58:53.531278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ================================================================================ {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:58:53.531369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ================================================================================ {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:58:53.531686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] admin_token = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.531764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] admin_token = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] config_dir = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] config_dir = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] config_source = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] config_source = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.532981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] debug = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.533062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] debug = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.533302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.534971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_config_append = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_config_append = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.535968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_dir = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_dir = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_file = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_file = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.536996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.537283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.537402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.537692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.537813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.538826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.539112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.539227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.539521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.539646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.539908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.540029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.540294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.540411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.540683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.540806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.541068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.541192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.541472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.541603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.541902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.542020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.542359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.542484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.543747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.543963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] publish_errors = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] publish_errors = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.544937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.545104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.545232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.545515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.545651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.545924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.546058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.546319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] standard_threads = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.546438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] standard_threads = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.546707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.546835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] use_journal = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] use_journal = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.547990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] use_json = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] use_json = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] use_stderr = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] use_stderr = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] use_syslog = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] use_syslog = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.548928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.549049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:58:53.549356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.549482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.549755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.549895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.550218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.550346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.550618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.550742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.551966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.552238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.552362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.552650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.552776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.553062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.553180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.553475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.553599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.553867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.554000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.554302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.554421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.554698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.554819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.555113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.555238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.555526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.555652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.555923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.556047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.556349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.556479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.556776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.556893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.557191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.557311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.557588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.557793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.558036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.558158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.559083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.559217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.559518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.559651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.559938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.560058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.560330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.560454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.560717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.560846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.561104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.561222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.561501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.561621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.561933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.562067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.562350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.562469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.562737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.562854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.563122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.563250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.563534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.563653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.563945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.564063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.564341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.564471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.564754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.564874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.565224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.565377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.565528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.565650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.566844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.567094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.567220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.567479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.567599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.567874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.568001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.568286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.568414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.568672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.568797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.569069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.569193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.569455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.569592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.569849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.570032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.570266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.570386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.570677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.570799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.571975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.572245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.572371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.572636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.572755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.573968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.574274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.574395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.574690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.574849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.575098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.575250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.575541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.575693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.575953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.576078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.576351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.576476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.576758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.576878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.577164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.577284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.577613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.577738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.578993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.579272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.579399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.579670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.579788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.580990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.581267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.581386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.581670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.581795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.582088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.582208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.582485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.582615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.582881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.583007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.583273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.583392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.583667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.583785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.584095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.584217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.584495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.584619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.584898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.585017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.585298 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.585425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.585702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.585821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.586126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.586253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.586520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.586649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.586918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.587037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.587304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.587422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.587689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.587815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.588980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.589255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.589373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.589692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.589818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.590202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.590431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.590551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.590666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.590954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.591073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.591388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.591520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.591802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.591928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.592199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.external = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.592319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.external = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.592625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.592758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.593094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.593242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.593482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.593608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.593866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.password = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.594005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.password = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.594276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] auth.token = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.594410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] auth.token = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.594674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.594794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.595983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.596275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.596402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.596686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.596834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.597075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.597197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.597469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.597597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.597916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.598054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.598313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.598434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.598726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.598854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.599120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.599253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.599525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.599644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.599917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.600035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.600337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.600468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.600761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.600888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.601156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.601277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.601577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.601700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.602074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.602198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.602489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.602610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.602926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.603046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.603333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.603452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.603759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.603877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.604154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.604273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.604551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.604669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.604963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.605084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.606973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.607254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.607376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.607681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.607804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.608080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.608200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.608503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.608625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.608901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.609020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.609314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.609434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.609708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.609834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.610152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.610273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.610567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.610687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.610963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.611085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.611359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.611480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.611767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.611887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.612156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.612277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.612555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.612676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.612972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.613091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.613387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.613516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.613773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.613914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.614197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.614316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.614585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.614700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.614999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.615120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.615412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.615532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.615828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.615955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.616258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.616377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.616672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.616792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.617120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.617240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.617517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.617636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.617947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.618082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.618339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.618458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.618737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.618855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.619124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.619253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.619531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.619662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.619919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.620040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.620319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.620448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.620730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.620849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.621703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.621948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.622192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.622376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.622574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.622804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.622982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.623206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.623609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.623829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.624035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.624256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.624433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.624652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.624841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.625063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.625239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.625456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.625648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.625864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.626078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.626302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.626493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.626714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.626903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.627129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.627309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.627788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.627993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.628214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.628416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.628638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.628813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.629038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.629212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.629437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.629635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.629863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.630090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.630316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.630500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.630723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.630906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.631130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.631314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.631535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.631710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.631930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.632121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.632341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.632559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.632779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.632957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.633176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.633383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.633599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.633807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.634062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.634259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.634485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.634668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.634893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.635063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.635287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.635466 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.635688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.635869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.636092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.636275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.636547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.636740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.636955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.637120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.637375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.637542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.637797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.637993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.638245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.638412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.638664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.638831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.639088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.639217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.639479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.639628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.639895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.640015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.640300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.640422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.640709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.640830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.641118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.641244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.641520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.641645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.641966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.642091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.642380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.642499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.642777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.642899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.643171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.643293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.643557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.643678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.643953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.644077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.644347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.644466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.644739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.644869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.645132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.645251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.645526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.645645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.645938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.646083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.646328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.646450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.646722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.646849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.647121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.647251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.647530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.647652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.647922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.648044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.648312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.648442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.648711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.648830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.649108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.649228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.649502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.649630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.649901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.650022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.650304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.650423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.650688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.650820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] role.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] role.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] role.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] role.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.651974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.652292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.652482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.652706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.652829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.653145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.653313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.653568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.653735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.654026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.654187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.654450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.654614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.654872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.655040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.655297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.655441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.655697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.655866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.656118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.656290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.656541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.656707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.656968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.657132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.657384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.657844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.658089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.658271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.658489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.658692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.658911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.659118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.659336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.659544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.659754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.659967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.660177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.660369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.660573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.660797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.660996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.661221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.661416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.661625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.661818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.662055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.662246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.662453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.662640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.662848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.663032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.663272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.663451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.663706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.663882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.664130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.664302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.664537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.664703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.664936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.665103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.665333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.665495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.665739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.665919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.666172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.666330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.666587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.666742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.666991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.667156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.667427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.667592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.668602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.668732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.669988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.670299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.670430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.670694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.670812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.671091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.671211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.671484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.671612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.671893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.672013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.672304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.672424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.672686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.672814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.673090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.673211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.673571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.673692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.connection = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.connection = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.674968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.675239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.675359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.675641 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.675763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.676945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.677219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.677341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.677627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.677747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.678968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.679261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.679382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.679654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.679792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.680961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.681234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.681352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:58:53.681514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81921) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:58:53.681644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:58:53.732240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.732587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.732842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.732929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.733198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.733559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.748578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.749133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.795888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.796057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.796164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.796245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.885344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.885537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.969764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.970010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.970148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:53.970235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.203564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.203767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.203920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.204964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.205101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.205310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.205449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.243483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.243716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.243830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.243934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.246909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.247043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.247153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.247153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.247292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.264885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.264999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.286018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.286280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.286378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.286647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.286733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.287785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.288031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81921) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.288115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.288371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 19:58:54.315977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.316286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:54.316395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.316602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:54.316825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.317131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:54.317214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.317446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 19:58:54.317563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.317911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.317996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.318323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.318405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.318734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.319182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.319526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.336842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.336948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.337268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.337353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.337682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.337766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.338146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.338234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.351119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.351241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.356250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.356352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.356696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.356794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.357133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.357215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.357571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.357659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.358963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.359311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.359395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.359900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.359989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.360344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.360435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.360776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.360864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.402829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.403002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.405325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.405427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.405775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.405862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.414009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.414115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.414457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.414544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.414895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.414981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.426254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.426428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.426700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.426786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.433910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.434060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.434392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.434551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.434843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.434996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.435293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.435444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.435835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.435932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.436185 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.436277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.436601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.436696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.437041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.437123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.469267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.469873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.469873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.470434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.476804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.477021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.483351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.483532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.483847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.483981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.491532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.491721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.497713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.499130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.503848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.504001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.504330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.504415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.504773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.504860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.505220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.505303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.505655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.505739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.506128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.506213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.535758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.535987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.536235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.536318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.536655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.536739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.537068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.537149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.550140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.550323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.552836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.552932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.553269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.553354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.557919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.558026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.558398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.562831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.580734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.580858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.581194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.581285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.581644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.581737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.582137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.582221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.582578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.582680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.583018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.583101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.583456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.583538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.612204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.612368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.617449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.617549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.623098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.623331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.625590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.625737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.628396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.628522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.628869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.629006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.629331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.629447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.640782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.640934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.643323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.643430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.648475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.648618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.653988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.654141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.654141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.654365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.654482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.654616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.663983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.664113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.664454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.664539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.664890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.664988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.677861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81921) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.678179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 19:58:54.678341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.678644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.678784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.682540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.682664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.682802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.682929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.683045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.683174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.683286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.683483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.684934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81921) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.685743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 19:58:54.746614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7c3fdf9c0 pid: 81920 (default app) Aug 17 19:58:54.747497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7c3fdf9c0 pid: 81921 (default app) Aug 17 19:58:54.750937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a487-7ef3-4bc2-9eaa-a389c1b0b6b8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:58:54.751226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a487-7ef3-4bc2-9eaa-a389c1b0b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:58:54.751499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a487-7ef3-4bc2-9eaa-a389c1b0b6b8 None None] PATH_INFO: `/v3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:58:54.756030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Wed Aug 17 19:58:54 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:03.015700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:03.016355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:03.016355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:03.020566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:03.026639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:03.032972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:03.032972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:03.098284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: INFO dbcounter [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] Registered counter for database keystone Aug 17 19:59:03.120736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG oslo_db.sqlalchemy.engines [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:59:03.128289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writer thread running {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:59:03.315337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG passlib.handlers.bcrypt [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81920) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:59:03.315698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG passlib.handlers.bcrypt [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81920) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:59:03.371962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:03.373611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:03.510102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 19:59:03.825461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:03.896107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: INFO dbcounter [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] Registered counter for database keystone Aug 17 19:59:03.916717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG oslo_db.sqlalchemy.engines [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81921) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:59:03.923058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writer thread running {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:59:04.050125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7cfa9-6a0b-4c63-a902-5d8c0389a55b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:04.054420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:04.055056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.055338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.055608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.064879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:04.115635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING keystone.common.rbac_enforcer.enforcer [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:59:04.115901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8470-335f-47b3-940a-b50870d7b30e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:04.127212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Aug 17 19:59:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 19:59:04.133297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:04.148040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5880b-c6d8-437b-8266-99d101320d5c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:04.152746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:04.153894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:04.154208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:04.154483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] PATH_INFO: `/v3/projects/4cdb00bd40c94bdca97e51936bedf565` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:04.156094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cdb00bd40c94bdca97e51936bedf565)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:04.209124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 19:59:04.209471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fbe7-2d35-490e-a589-084238d7aca3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:04.214390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Wed Aug 17 19:59:04 2022] GET /identity/v3/projects/4cdb00bd40c94bdca97e51936bedf565 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:06.152214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a71f-7b42-4067-a98c-5bee16e213cb None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:06.152754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a71f-7b42-4067-a98c-5bee16e213cb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:06.152845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5a71f-7b42-4067-a98c-5bee16e213cb None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:06.156923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:06.162263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:06.162690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:06.162810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:06.183468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:06.184992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:06.192826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 17 19:59:06.460085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5a71f-7b42-4067-a98c-5bee16e213cb None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:06.473137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5a71f-7b42-4067-a98c-5bee16e213cb None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:06.477283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:06.477906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:06.478192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:06.478465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:06.487710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:06.489523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d01b-6432-48d5-bf09-ef4fc6a4c3d6 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:06.500029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Aug 17 19:59:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 19:59:06.506130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:06.515439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea0e3-f00a-49f8-b6d9-f270e38ae21a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:06.519776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:06.520397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:06.520675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:06.520944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:06.522274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:06.524095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75aac-ee08-4e7f-bdcb-d2ce18014c7d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:06.525608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Wed Aug 17 19:59:06 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:08.508327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacec1-9801-4879-84df-eac72776a665 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:08.508861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacec1-9801-4879-84df-eac72776a665 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:08.508961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacec1-9801-4879-84df-eac72776a665 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:08.511065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:08.516806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:08.517260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:08.517353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:08.527452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fca95-90fa-41d7-91bf-5244a02e9289 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:08.527729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fca95-90fa-41d7-91bf-5244a02e9289 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:08.528005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fca95-90fa-41d7-91bf-5244a02e9289 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:08.529324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:08.534585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:08.534858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:08.535108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:08.536537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:08.537739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:08.578889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG passlib.handlers.bcrypt [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81921) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 19:59:08.579304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG passlib.handlers.bcrypt [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81921) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 19:59:08.625088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:08.626986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:08.629650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:08.730046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:08.917235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:08.942701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:08.995685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.037798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a934bf-f515-49dc-950e-704c2785dd0b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.076412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.077089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.077371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.077646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.090592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:09.099182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:09.100426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:09.101628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:09.107343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.126084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed18c34-a502-4f67-bee6-f6b4be5f56e4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.128719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.173135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.173986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.174901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.174901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.204660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.227295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0dd80-16a4-46ad-9e5d-bc11d45a69ac None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.266237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.268548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.271335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.271976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.272258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.272531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.273213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:09.273547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.275040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.291300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:09.297690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.393642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:09.403243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.408219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.424789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc903d-1ece-4ce0-81a2-e0bb045d8e7f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.464143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.464836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.465285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.465562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.466827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.468335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.469998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:09.476000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.493794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.558416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967192e-b25c-4a9a-827c-4aca31a393de None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.595351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.596229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.596515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.596841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.617843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.619524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.630640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7c98f-c1f9-4a59-887c-11b90f09c584 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:59:09.640277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:09.642111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:59:09.643379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:59:09.643379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:09.643379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:09.643379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:09.648031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.684999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.685564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.685849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.686154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.687299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.689155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.690810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:09.697037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:09.733364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.796697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65e6d6-af4a-4f44-966e-229eef27a012 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.802744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:09.829362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ec82-ab18-4e57-aa14-798445727e7b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:09.842958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.843727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.844130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.844530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.845283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:09.845675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.847429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa553ae2-ea70-40aa-922a-e5781b92cea1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.871074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:09.871301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:09.871988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:09.872278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:09.872754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:09.873608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.domain.id=default, user.id=33f3999b36d7469f8f3b2c27f834129d) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:09.874052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:09.875649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459636-c413-422d-95d5-cd735fa3283d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:09.884380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Aug 17 19:59:09 2022] GET /identity/v3/role_assignments?user.id=33f3999b36d7469f8f3b2c27f834129d&scope.domain.id=default&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:12.948842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1b10-c19a-4312-8592-bd031af7e354 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.950402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1b10-c19a-4312-8592-bd031af7e354 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.951191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1b10-c19a-4312-8592-bd031af7e354 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:12.954503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:12.965274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac90c-29c2-4987-a22b-7f015f45a6d8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:12.966777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac90c-29c2-4987-a22b-7f015f45a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:12.967565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ac90c-29c2-4987-a22b-7f015f45a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.010377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dd2ac90c-29c2-4987-a22b-7f015f45a6d8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:13.012949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dd2ac90c-29c2-4987-a22b-7f015f45a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:13.157210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf56d-d75c-4e4d-9fc2-8bfb5347538a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.157489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf56d-d75c-4e4d-9fc2-8bfb5347538a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.157760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf56d-d75c-4e4d-9fc2-8bfb5347538a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.159735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 12/23] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:13.179978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adf32-57b2-4cdb-bbca-4c43a425fc60 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.180534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:13.181053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adf32-57b2-4cdb-bbca-4c43a425fc60 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.181606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95adf32-57b2-4cdb-bbca-4c43a425fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.223091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e95adf32-57b2-4cdb-bbca-4c43a425fc60 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:13.224697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e95adf32-57b2-4cdb-bbca-4c43a425fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:13.341786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:13.449593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6953c-a4c7-4b84-8ec1-aa8d497995b1 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.450255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6953c-a4c7-4b84-8ec1-aa8d497995b1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.450727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6953c-a4c7-4b84-8ec1-aa8d497995b1 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.452270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 13/26] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:13.458300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:13.458566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:13.458810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:13.495198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:13.496352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:13.558605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:13.597065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:13.782632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6953c-a4c7-4b84-8ec1-aa8d497995b1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.796994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:13.955364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd33854-af90-45a7-be5c-0805030c4138 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.015589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.020102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.021086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.021570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.022072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.023000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.024658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.059783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6953c-a4c7-4b84-8ec1-aa8d497995b1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.098155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.098810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.099089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.099362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.111131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:14.116140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:14.117122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:14.118411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:14.119211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.249846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcfba3-3ab7-4325-b036-91f77f813d49 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.287831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 15/29] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:13 2022] POST /identity/v3/roles => generated 219 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:14.289330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.307380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.308163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.308447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.308780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.322948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.331298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.333263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 19:59:14.364756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:14.365689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 19:59:14.366535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 19:59:14.366535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 19:59:14.366535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:14.366535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:14.377309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.419222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.568028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b5891-da19-4c4a-b8f8-04baef668fa2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.595241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae4a1a-16f2-49c5-8a5e-a4dedd6e5c29 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.610890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.611515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.611796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.612066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.612728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:14.613218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.614853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80dbb-db91-4879-a258-aa5cfa30e5bc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.636467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 16/31] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:14.638093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a4ff-c58d-4157-9f34-176afb6a04c7 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.638545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a4ff-c58d-4157-9f34-176afb6a04c7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.638823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a4ff-c58d-4157-9f34-176afb6a04c7 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.640383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 17/32] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:14.641365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a362-ad07-4cc9-a563-149ef5e15ee8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.641646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a362-ad07-4cc9-a563-149ef5e15ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.641937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a362-ad07-4cc9-a563-149ef5e15ee8 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.643423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 18/33] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:14.645053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc4aa-0224-4d5b-bf01-b1952dcfbbfd None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.645336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc4aa-0224-4d5b-bf01-b1952dcfbbfd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.645604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bc4aa-0224-4d5b-bf01-b1952dcfbbfd None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.647164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 19/34] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:14.649498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.651060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.651060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.651317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.651615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bc4aa-0224-4d5b-bf01-b1952dcfbbfd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:14.652457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:14.652773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.654418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72b95f-3f32-4e99-9c3f-0f60b0b951e9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.667280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 16/35] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:14.668743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694e00-5a66-49ad-a18d-c95cd2484875 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.669192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694e00-5a66-49ad-a18d-c95cd2484875 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.669475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694e00-5a66-49ad-a18d-c95cd2484875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.691112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-81694e00-5a66-49ad-a18d-c95cd2484875 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:14.693518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-81694e00-5a66-49ad-a18d-c95cd2484875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:14.715232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.778890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bc4aa-0224-4d5b-bf01-b1952dcfbbfd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:14.795647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:14.796959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839450d-30de-47e9-8e99-ce8ef5ed8dba None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.797332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839450d-30de-47e9-8e99-ce8ef5ed8dba None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.797614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839450d-30de-47e9-8e99-ce8ef5ed8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.821374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3839450d-30de-47e9-8e99-ce8ef5ed8dba None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:14.824027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3839450d-30de-47e9-8e99-ce8ef5ed8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:14.846778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:14.847732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.848226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.848709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.849957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:14.852635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:14.855771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:14.917087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:14.919366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:14.919900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:14.920390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:14.950931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:14.952885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:15.073274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:15.079739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.204871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.214001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:14 2022] POST /identity/v3/projects => generated 301 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:15.215828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.232006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ca837-bd30-432a-a9d3-ef91c3527f05 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.310518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.311651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.312149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.312615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.316378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.320374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.325266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 20/40] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.326823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.379984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.385997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55692b-bdb2-4074-bc23-b9e86eac756c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.442940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.443574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.444054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.444560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.445367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.447377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.502192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad4ff-259c-441a-869f-ab20086af923 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.522008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:15 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:15.522962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.569077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.570040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.570511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.570966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.572187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.574217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.669976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 17 19:59:15 2022] POST /identity/v3/roles => generated 223 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:15.669976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.709016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.721072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93003fdd-4ca2-4aca-bff1-a641a48a0558 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.797029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.797907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.798283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.798574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.800039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.801615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.803686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.810471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:15.847445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:15.863649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee76ee-6109-41f7-9d26-a14c22114bc2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:15.918948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:15.920186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:15.920729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:15.921242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:15.924155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:15.927133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:15.930274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:15.937250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:16.062366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82904e-1c76-4897-98e0-8a2c551a6353 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:16.074972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:16.094449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e673626-1c9f-48e6-a43f-6dc4fd997b76 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:16.108273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:16.109084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:16.109479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:16.109994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] PATH_INFO: `/v3/domains/default/users/33f3999b36d7469f8f3b2c27f834129d/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:16.113158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=33f3999b36d7469f8f3b2c27f834129d, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:16.114989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f46df4-c140-4406-92f4-dca647cb34d3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:16.135574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:16.136773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:16.136773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:16.136773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:16.137401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:16.139039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efb41e-027d-405b-b2b5-12c9911f8e03 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:16.199810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 23/45] 10.222.0.48 () {58 vars in 1361 bytes} [Wed Aug 17 19:59:15 2022] PUT /identity/v3/domains/default/users/33f3999b36d7469f8f3b2c27f834129d/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:16.227400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:15 2022] POST /identity/v3/projects => generated 312 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:18.204371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc350c-6a9e-4733-a258-0bcfea7631e9 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.204951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc350c-6a9e-4733-a258-0bcfea7631e9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.205397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc350c-6a9e-4733-a258-0bcfea7631e9 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.207992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:18.217388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.217983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.218422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.251051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:18.253191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:18.330196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0c9-966f-4bda-9188-002f53c94587 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.330624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0c9-966f-4bda-9188-002f53c94587 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.331119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423dc0c9-966f-4bda-9188-002f53c94587 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.333415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 25/48] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:18.340546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.341008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.341478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.341953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 24/49] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:18.362158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:18.363924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:18.472287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:18.659562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.750282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.769472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:18.774568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:18.822840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbcfbe-22b9-49cc-acf6-b96cde8e96ba None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.872739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.873684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.874089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.874431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.889709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:18.894165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480350d-d29d-471d-bc43-c06b0279e4a2 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:18.896381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:18.898027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:18.898801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:18.908126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:18.940862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:18.941679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:18.942128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:18.942502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:18.943937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:18.945637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:18.948931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:18.955842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.082914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.111166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1576d2-b10b-4027-a27f-2ba15129f65a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.160196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de470c74-2674-4ae9-a1ef-7e099332c004 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.170934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.171566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.171893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.172182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.172830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.174387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.199300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.208830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.209453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.209741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.210060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.210750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:19.211113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.213221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.222755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:19.229263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.268246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 28/54] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Aug 17 19:59:18 2022] POST /identity/v3/projects => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:19.380673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e435b-ee0a-41f6-93e3-d766432338e6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.442451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.443479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.443949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.444401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.446411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.449098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.452060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:19.458789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.607093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7472a-9081-4bec-8bdc-7e707ad0d6c7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.667852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.668947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.669419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.669919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.672047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.674897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418a4fc-8359-45ef-903c-631b3a16fd13 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.677935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:19.685050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:19.788750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:19.874227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0484-d9b9-4da0-aea5-d6c893b0d6bd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:19.936646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:19.937606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:19.938158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:19.938671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:19.940070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.domain.id=default, user.id=33f3999b36d7469f8f3b2c27f834129d) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:19.940645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:19.943404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65010e6-c7e7-403e-91be-21669b385036 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:19.961456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Aug 17 19:59:19 2022] GET /identity/v3/role_assignments?user.id=33f3999b36d7469f8f3b2c27f834129d&scope.domain.id=default&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 530 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:21.329218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9edfc0-0f30-4e62-a9fd-9d79cd32e246 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.329771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9edfc0-0f30-4e62-a9fd-9d79cd32e246 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.329936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9edfc0-0f30-4e62-a9fd-9d79cd32e246 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.331397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:21.339469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.340023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.340110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.360344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:21.361617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:21.440633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:21.716702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9edfc0-0f30-4e62-a9fd-9d79cd32e246 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.720831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.827170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9edfc0-0f30-4e62-a9fd-9d79cd32e246 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:21.868104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:21.869350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:21.869664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:21.870224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:21.871627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:21.873231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd6d81-5fe0-4c22-90e1-8aa4cd918293 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:21.875095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:21.881394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:21.941310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:21.999718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22650038-477d-4436-af8a-dcb7e76c2973 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:22.037006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:22.037678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:22.037988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:22.038266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:22.038965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:22.041169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca67cc-a137-4349-b0cc-697a9434db0a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:22.169832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:21 2022] POST /identity/v3/users => generated 275 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:26.003896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24332-7b3c-49cd-9d4c-9c446fe67ec1 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.004536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24332-7b3c-49cd-9d4c-9c446fe67ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.004951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff24332-7b3c-49cd-9d4c-9c446fe67ec1 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.007063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.013633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0eda7-716e-4744-a317-28034813e17c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.014315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0eda7-716e-4744-a317-28034813e17c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.014315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0eda7-716e-4744-a317-28034813e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.038995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6cd0eda7-716e-4744-a317-28034813e17c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:26.040669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6cd0eda7-716e-4744-a317-28034813e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:26.138973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:26.185843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02310a0-eb09-41a5-a59f-008386b54c82 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.186810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02310a0-eb09-41a5-a59f-008386b54c82 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.187611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02310a0-eb09-41a5-a59f-008386b54c82 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.190917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 33/64] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.201475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b10c3-e2dc-4551-9d1d-7c3deb7e77f8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.201750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b10c3-e2dc-4551-9d1d-7c3deb7e77f8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.202317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b10c3-e2dc-4551-9d1d-7c3deb7e77f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.233435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-021b10c3-e2dc-4551-9d1d-7c3deb7e77f8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:26.235100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-021b10c3-e2dc-4551-9d1d-7c3deb7e77f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:26.293664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f21fb-450c-4059-a98f-17f4599d86ed None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.293991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f21fb-450c-4059-a98f-17f4599d86ed None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.294269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f21fb-450c-4059-a98f-17f4599d86ed None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.295000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.295651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 34/65] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:26.302234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd6bf-183c-45bb-b09a-b4783aee4ef8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.302521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd6bf-183c-45bb-b09a-b4783aee4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.302796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fd6bf-183c-45bb-b09a-b4783aee4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.330986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b13fd6bf-183c-45bb-b09a-b4783aee4ef8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:26.332540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b13fd6bf-183c-45bb-b09a-b4783aee4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:26.393411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 32/66] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:26.395197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b280-7823-4f47-87fb-f98ddd1995c0 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.396018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b280-7823-4f47-87fb-f98ddd1995c0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.396776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6b280-7823-4f47-87fb-f98ddd1995c0 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.402869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 33/67] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.404438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7eead-6b33-4118-809f-059754eb3b26 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.404669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7eead-6b33-4118-809f-059754eb3b26 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.404959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7eead-6b33-4118-809f-059754eb3b26 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.406817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 34/68] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:26.408692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.408692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.408870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.432367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:26.434123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:26.446295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:26.453905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.453905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.453905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.454913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.470010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:26.471539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:26.584437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:26.590734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:26.729027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:26.743362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:26.836300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.844840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830521e8-495e-493c-8386-d5860f3d12f1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:26.885356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.886052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.886431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.886664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.897327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:26.898458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ae743-a4f2-4cbf-88f6-a809a896fdc7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:26.902827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:26.903707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:26.904479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:26.905836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:26.942304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:26.948334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:26.948990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:26.949274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:26.949549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:26.960960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:26.966496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:26.967462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:26.968256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:26.970317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.029365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ca3a9-279e-4e85-884d-8f59031e6b68 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.068702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.069348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.069625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.069919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.081629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:27.084455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5a03-628d-419a-9824-99644325af99 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:27.087226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:27.088231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:27.088990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:27.089626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.111703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.130907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.132447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.132730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.133000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.148424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:27.154122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:27.155177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:27.157645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.210557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1839e2-70f1-423e-be37-6f711d761c95 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.218606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.256994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.259148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.259633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.260079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.261241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:27.261759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.263783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.273936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.275517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.283707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7797-9d26-4a23-817b-08bf620e5a5b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.325948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.326696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.327162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.327657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.328443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:27.328809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.330621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.341415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.342875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.379324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.404629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da662eb6-0362-4863-ae2a-39d8f6c6427f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.441057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.441690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.442014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.442297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.442976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:27.443287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.444735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.454329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.455203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.465684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7ec91-8e3c-48d1-8241-e9043da2b35f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.484112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.508542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.509397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.509828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.510260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.511594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.513285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.515075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.517754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.570563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32afccd-8411-4118-a845-2ae0691a9001 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.607129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.607660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.607939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.608213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.608883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:27.609187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.610625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.619739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.620587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.623920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.635846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76d38-95df-427e-b967-9f7fb721af6a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.672575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.673228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.673511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.673784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.675039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.676508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.678212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.678998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.730914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6bfd-e6db-476b-ad31-05b8a5dbf7df None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.732803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.768186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.768844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.769121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.769399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.786374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.788254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.789767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebec6ed-f2b0-4ee1-b47b-92f8352a080b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.790485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.791312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.827678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.828366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.828626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.828907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.830144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.831670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.833521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:27.834144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:27.857676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:27.925368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2549f3-362f-4dd9-9f67-26d204fae527 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:27.975222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:27.976092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:27.976475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:27.976946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:27.978343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:27.980037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:27.984081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59c1b-e159-4af5-a79b-5cce59ba89e4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.004144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.025022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.025681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.026055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.026334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.027576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:28.029049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:28.030739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:27 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:28.031558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.143965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 42/85] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:27 2022] POST /identity/v3/users => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:28.145472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.156098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec0fe1-df40-49b6-9c37-4c74c1e1f57a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.218933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.219936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.220376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.220796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.301174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f7b6-e3d6-4de8-94d5-d77e089b4c32 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.317722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.325499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.340257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:28.342364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:28.348198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.348954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.349315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.349666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.466152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:28.467997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:28.544862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 44/86] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:28.545629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.687878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 43/87] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:28.689202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:28.707242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.725031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:28.733273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bdb3a-1c32-4a78-a6d1-06a12c4b1b19 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.790038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.791477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.791969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.792575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:28.865628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62083d81-812b-4981-a1d2-a914726844f3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:28.910856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:28.913459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:28.929559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:28.931547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:28.931849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:28.932322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.038747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.042261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.045437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.069383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 45/88] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:29.070173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.072516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.222112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 44/89] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:29.222940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11534bf0-9733-40a2-9763-7276ada1ec19 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.225483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.281156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.281156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.281156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.281481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.283682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.285162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.286891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.287928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.387765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.393860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27badda-7218-4441-9c87-e67de63ee7cf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.436715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.442957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.443825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.444250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.444666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.446092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b79a21-6913-482d-bd93-44b06aa3c7fc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.446365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.448124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.454281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 45/91] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.455534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.499211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.500456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.500933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.501347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.502748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.504389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.506276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.507250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.575224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ffc18-a245-40c7-8ae0-ab7ca2cafb70 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.615373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.616427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.616944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.617995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] PATH_INFO: `/v3/projects/5f6e4110246c469583940b3e9f6f8549` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.619436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6e4110246c469583940b3e9f6f8549)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.621148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.623266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/projects/5f6e4110246c469583940b3e9f6f8549 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.624307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.655248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305b087-f01b-4e16-9c6e-ce7818cf61f0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.683196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.689856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:29.697267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.698251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.698850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.699331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.700404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=33f3999b36d7469f8f3b2c27f834129d) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.700911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.702667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.708990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/role_assignments?user.id=33f3999b36d7469f8f3b2c27f834129d&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.710139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.828508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b772ac-13f8-46df-a612-89b591f1afa4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.872449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d1151-3e7d-42da-963b-69e8cd5bc56e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:29.910636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.912195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.912195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.912195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.912554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.912853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.914500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.921774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 47/95] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=f25e512661f54369b009eabe1c62d99a => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:29.922886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:29.923324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:29.924266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:29.924758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:29.925256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:29.926337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:29.926887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:29.928659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032236a-af4f-4620-8dd4-b3780edb3953 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:29.936938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:30.136564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c411305-c30b-4734-94e1-73f021a98e96 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:30.156816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:30.186605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:30.187594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.188117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.188624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.190819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=5f6e4110246c469583940b3e9f6f8549, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:30.191681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:30.200604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d4c56-82fb-46bf-b73c-a9b19e4759fe None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:30.212259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:29 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=5f6e4110246c469583940b3e9f6f8549&role.id=f25e512661f54369b009eabe1c62d99a => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:30.987343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537731a-0406-4876-a61a-c215b35291df None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.988375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537731a-0406-4876-a61a-c215b35291df None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.988896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537731a-0406-4876-a61a-c215b35291df None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:30.990521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:30.996812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:30.997806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:30.998311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.024819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:31.026634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:31.116387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:31.561267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537731a-0406-4876-a61a-c215b35291df None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.641507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:31.746047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537731a-0406-4876-a61a-c215b35291df None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:31.802872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:31.803564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.803849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.804122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.823805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-34b2aa1a-1fb6-417a-8d41-e8658b8b1fdd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:31.829346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:31.830430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:31.831232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 51/100] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:31.837519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:31.880195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be6ab-ebbd-498b-bce3-6bedb030314f None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.880681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be6ab-ebbd-498b-bce3-6bedb030314f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.881535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260be6ab-ebbd-498b-bce3-6bedb030314f None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.885094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 52/101] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:31.894716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:31.895154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:31.895620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:31.931419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:31.934367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:32.129595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c2bec-ae63-4ddf-9b42-107a1f49e58f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.158333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.158515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 53/102] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:32.215404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.216055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.216345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.216620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.217408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:32.217726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.219220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2399f-25be-4b1b-9b55-470fdd3b9b45 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.235574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 50/103] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:32.242592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.360503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.400410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6470-502a-4568-993c-0c048813dcee None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.400607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6470-502a-4568-993c-0c048813dcee None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.400893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee6470-502a-4568-993c-0c048813dcee None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.402678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 51/104] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:32.424930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.425548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.426096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.449348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a859f-4919-4ee2-9c03-d69ae8458131 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.487111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:32.488761 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:32.510340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.511281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.511812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.512281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] PATH_INFO: `/v3/users/67004177578d455ca8140015c5fc8a44` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.547743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] RBAC: Authorizing `identity:get_user(user_id=67004177578d455ca8140015c5fc8a44)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.549273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.555913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 54/105] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/users/67004177578d455ca8140015c5fc8a44 => generated 289 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:32.561865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:32.626904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 52/106] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:32.761189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac355d6-527d-4baa-8996-9cd8a382a244 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:32.762938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:32.812581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:32.813227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:32.813513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:32.813793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:32.930587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:32.932104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:32.935262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.160015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa9ed3-917e-47f6-ac16-0ab05f99eef1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.161980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.168628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 55/107] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:33.169400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.177820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.263235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.264160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.269693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.270223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.290142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:33.298359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:33.299307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:33.300084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:33.302472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 53/108] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:33.303635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.421167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256237b-b023-4b68-be6b-57b9b5f88a16 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.440739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcde84-c448-454d-b134-532478b0f913 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.472931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.474648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.475596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.476272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.480401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.483255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.488815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 54/109] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.490724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.517285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.518408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.519209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.520277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.521792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.524143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c280b0-b364-46c6-a864-57e1c7e9c88c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.527161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 56/110] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.528784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40b92-c391-4296-98b3-3c54c823808d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.529062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40b92-c391-4296-98b3-3c54c823808d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.529472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40b92-c391-4296-98b3-3c54c823808d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.530912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 57/111] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:33.531765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40b92-c391-4296-98b3-3c54c823808d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.544231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.629531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.636124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a7f05-1081-4ae1-bba4-6fa3a481dcec None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.678279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40b92-c391-4296-98b3-3c54c823808d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.678536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.678942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.679228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.679547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.680311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:33.680994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.683391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73495748-0140-4313-b522-f84d793e5e60 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.695893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 55/112] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.697834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb431c-41c4-42c2-ba88-fa38d4e08ede None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.698286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb431c-41c4-42c2-ba88-fa38d4e08ede None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.698734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb431c-41c4-42c2-ba88-fa38d4e08ede None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.700532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 56/113] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:33.702693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb431c-41c4-42c2-ba88-fa38d4e08ede None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.730881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.731585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.731915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.732328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.733120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=67004177578d455ca8140015c5fc8a44) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:33.733520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.735366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e70c4-2ee0-42a2-b405-b677726a8cb8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:33.742737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 58/114] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/role_assignments?user.id=67004177578d455ca8140015c5fc8a44&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=fb37488e6c8844d493ae349bead65655 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:33.748167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.748619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.749063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.773774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:33.775413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:33.852179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:33.868265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb431c-41c4-42c2-ba88-fa38d4e08ede None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:33.907194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 59/115] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:33.908531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:33.932510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:33.933148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:33.933599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:33.933959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:33.934709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:33.936358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9163cf9-30ec-460f-a427-c039bbaf1bb2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:34.023347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:34.025377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 57/116] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 19:59:33 2022] POST /identity/v3/projects => generated 302 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:34.027486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bc79-9276-4200-8b8d-cb014a59f597 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.027861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bc79-9276-4200-8b8d-cb014a59f597 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.028144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150bc79-9276-4200-8b8d-cb014a59f597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.054441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e150bc79-9276-4200-8b8d-cb014a59f597 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:34.056446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e150bc79-9276-4200-8b8d-cb014a59f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:34.111943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34d515-4828-425a-a42c-73e83cd1f4a0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:34.196874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 58/117] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:34.198568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6340d-e946-4e36-a662-2f5f449dc9a7 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.198859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6340d-e946-4e36-a662-2f5f449dc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.200083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6340d-e946-4e36-a662-2f5f449dc9a7 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.201524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 59/118] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:34.207580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.207933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.208214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.221021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:34.221828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.221978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.222320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.230284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:34.231945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:34.233781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 60/119] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:33 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:34.245843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:34.247253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:34.251535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:34.431361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 60/120] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:34.493951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ed070-0a17-4468-8a67-c9df6a671c23 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:34.531505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:34.536685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:34.553363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:34.571946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:34.572599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.572878 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.573395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.575950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:34.580508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:34.580508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 61/121] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:34 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:34.588715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:34.763210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784426f9-d541-48fc-9be7-d7266223a6a3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:34.809333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bfc65-7478-46a6-bbc6-be1ecbc79dd9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:34.839711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:34.840374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.840651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.840928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.868048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:34.879338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:34.880922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:34.882314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:34.893091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:34.893790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:34.894101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:34.894380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/33f3999b36d7469f8f3b2c27f834129d/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:34.903783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, user_id=33f3999b36d7469f8f3b2c27f834129d, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:34.905333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:34.973991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.000221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 62/123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:34 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/33f3999b36d7469f8f3b2c27f834129d/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:35.002021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.037972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4c2af-fbda-4e28-b0c7-248cb640167c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.081168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.082336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.082955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.083440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.097542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:35.103673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:35.104578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:35.105372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:35.107457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 62/124] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:35.108592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.214278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.247461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6d763-bedd-4b69-a061-dc5ab19c6be1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.256680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92d74-0f8f-4ad8-9bdc-e5b98f68bee4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.276383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.292398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.292398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.292398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.292398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.297200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.297978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.298334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.298685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.299514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:35.299820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.301323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.305931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:35.311179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:35.312376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:35.313968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:35.314713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 63/125] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:35.314713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.318155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 63/126] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:35.321218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.435696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f14b-a1fb-4cdb-bdf4-762cb16ac43b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.436193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1aad5-5057-488c-a3a0-8e5f100a9ff9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.456354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.477725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.478770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.479349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.479829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.480735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:35.481257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.482923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.488362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.489036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.489322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.489598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.494714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.495174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 64/127] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:35.496237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.496482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.498347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 64/128] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:35.504321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.588946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.616109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160acca7-f4c3-4519-9973-a1ec5dcba45d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.644834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbbc93-c21c-4f8b-a43c-b9b59e51b381 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.659417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.660448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.661047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.661519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.662463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:35.662977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.665332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.675520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 65/129] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:35.676715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.688297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.689019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.689306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.689586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.690905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.692447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.694152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 65/130] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:35.695807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.730402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:35.797605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f180e8-d950-4e80-ad61-4461e4185514 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.838203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:35.839370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:35.839857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:35.840328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:35.841808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:35.843641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:35.845869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 66/131] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:35.847036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:35.961191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571183f9-bea3-4389-8bcd-a729fba40378 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:35.974455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.001976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.004834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.004834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.004834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] PATH_INFO: `/v3/projects/5f6e4110246c469583940b3e9f6f8549` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.005339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] RBAC: Authorizing `identity:get_project(project_id=5f6e4110246c469583940b3e9f6f8549)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.007058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.009074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 67/132] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/projects/5f6e4110246c469583940b3e9f6f8549 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:36.010064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.026026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59b5c3-d2cb-4631-9c08-e186531db1b0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.108719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.131143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da766-9064-456a-a364-17c4ed8ddb39 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.173480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.174536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.174999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.175448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/e3a5432fcc7e499a908cd3704cc3a622/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.177640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, user_id=e3a5432fcc7e499a908cd3704cc3a622, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.180007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.186720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.187743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.188259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.188786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.190318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.192048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.194022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 66/133] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:35 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:36.195132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.289780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 68/134] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:36 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/e3a5432fcc7e499a908cd3704cc3a622/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:36.290675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.337642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72193ce8-15da-45f8-a99f-be47f45ccaac None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.366026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.381559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.383021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.385195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.385479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] PATH_INFO: `/v3/projects/5f6e4110246c469583940b3e9f6f8549/users/e3a5432fcc7e499a908cd3704cc3a622/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.389782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f6e4110246c469583940b3e9f6f8549, user_id=e3a5432fcc7e499a908cd3704cc3a622, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.391324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.513842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd08212-1dcb-44e3-aceb-30a4e3a91ac4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.528504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 67/135] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:36 2022] PUT /identity/v3/projects/5f6e4110246c469583940b3e9f6f8549/users/e3a5432fcc7e499a908cd3704cc3a622/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:36.592140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.593932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.594868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.595673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.598610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.602753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22cb1-4984-438e-84ed-8b69d9c56852 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.606635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 69/136] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:36 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:36.612973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:36.720450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:36.791828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f96a7-f9b2-4055-a9e5-406bcf62dd9b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:36.837995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:36.838630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:36.838914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:36.839196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/e3a5432fcc7e499a908cd3704cc3a622/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:36.841527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, user_id=e3a5432fcc7e499a908cd3704cc3a622, role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:36.843059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd864a-9bd7-446b-8669-483fe795f266 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:36.928677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:36 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/e3a5432fcc7e499a908cd3704cc3a622/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:37.108587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a426c-d337-4da8-ae56-2dc365692639 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.108587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a426c-d337-4da8-ae56-2dc365692639 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.108587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a426c-d337-4da8-ae56-2dc365692639 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.109391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:37.117334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcbe92-bf7a-4246-b95d-de335a92b70d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.117653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcbe92-bf7a-4246-b95d-de335a92b70d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.117923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcbe92-bf7a-4246-b95d-de335a92b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.146564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c7fcbe92-bf7a-4246-b95d-de335a92b70d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:37.147819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c7fcbe92-bf7a-4246-b95d-de335a92b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:37.246900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:37.296280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28729-1bb1-42f2-8d95-d9e81cd34bcc None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.297253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28729-1bb1-42f2-8d95-d9e81cd34bcc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.297728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28729-1bb1-42f2-8d95-d9e81cd34bcc None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.299389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 71/140] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:37.308067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.308702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.309198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.329532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:37.331151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:37.367562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.421780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:37.542101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed28729-1bb1-42f2-8d95-d9e81cd34bcc None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.698331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed28729-1bb1-42f2-8d95-d9e81cd34bcc None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.722271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:37.740267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.740928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.741201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.741477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.747054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.748647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:37.750757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:37.756478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:37.872073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c7af-8752-4ed6-8702-b721ba668ddb None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:37.912101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:37.912730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:37.913012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:37.913287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:37.914037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:37.915535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.027676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 71/143] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:37 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:38.031344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:38.272062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389e336-a62c-4d14-94f5-8aa50b7bebf6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:38.359108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.360071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.360541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.361000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.387651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:38.398243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:38.399208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:38.399980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:38.401048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:38.409811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:38.452572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:38.543721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85688755-49e2-4df4-925a-2705def5f494 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:38.584654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.586184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.586467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.586731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.587431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:38.587743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:38.589154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc03b5-9642-4292-a0ed-7faad9fc18ea None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.605630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:38.614818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:38.696880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:38.739715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864a4a-7671-4ed5-8ec3-f7e61d073000 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.740364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864a4a-7671-4ed5-8ec3-f7e61d073000 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.740813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6864a4a-7671-4ed5-8ec3-f7e61d073000 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.746173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 73/146] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:38.754490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.755114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.755556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.819651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:38.822151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:38.890269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8da6-5e19-40a7-a0bf-923b0a4fedff None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:38.960009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:38.961642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:38.962171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:38.962632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] PATH_INFO: `/v3/users/67004177578d455ca8140015c5fc8a44` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:38.964891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] RBAC: Authorizing `identity:get_user(user_id=67004177578d455ca8140015c5fc8a44)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:38.967538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:38.970891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:38 2022] GET /identity/v3/users/67004177578d455ca8140015c5fc8a44 => generated 289 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:38.979704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:38.990359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 74/148] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:39.184631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44813b-ebda-44de-b8e2-45fed1ea793f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:39.189443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:39.262358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:39.263447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.263936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.265153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.271357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:39.274293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940008a-19c2-4a4d-98c4-26636db27079 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:39.277547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:38 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:39.286682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:39.335891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:39.408852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5284-971a-4322-bebd-51bffcede887 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.409431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5284-971a-4322-bebd-51bffcede887 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.409765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5284-971a-4322-bebd-51bffcede887 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.416980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 76/150] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:39.424264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.424718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.425156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.479598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:39.481442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:39.528482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077cb4-69b0-4cc9-9a24-bb23121d434b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:39.617984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:39.618678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.618950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.619213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/67004177578d455ca8140015c5fc8a44/roles/fb37488e6c8844d493ae349bead65655` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.624900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, user_id=67004177578d455ca8140015c5fc8a44, role_id=fb37488e6c8844d493ae349bead65655)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:39.626416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:39.656195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:39.658359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:39.734729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 75/152] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:39 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/users/67004177578d455ca8140015c5fc8a44/roles/fb37488e6c8844d493ae349bead65655 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:39.875531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:39.881190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d24aa3-abe8-4b06-addc-5354222e7259 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:39.953268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:39.954233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:39.954652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:39.955058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:39.980862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:39.989721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:39.991397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:39.992956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 78/153] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:40.000187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.175016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.219669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f61a91-e38e-4c3e-a3ea-5b52fac8bab7 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.279715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.280388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.280814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.280962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.281598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:40.281920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:40.283318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:40.299386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 76/154] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:40.304961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.358601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.523863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ecd-22ec-4cf1-a853-ec0bb33defb2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.609289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9de7-4967-4ab0-ab6e-8143d3a7f6fb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:40.612219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.612878 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.613162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.613464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] PATH_INFO: `/v3/users/33f3999b36d7469f8f3b2c27f834129d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.614678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] RBAC: Authorizing `identity:get_user(user_id=33f3999b36d7469f8f3b2c27f834129d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:40.616187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:40.618758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 79/155] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/users/33f3999b36d7469f8f3b2c27f834129d => generated 247 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:40.625603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.705993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:40.706647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:40.706922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:40.708351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:40.719502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.728806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:40.736916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:40.753936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:40.755692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:40.759693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 77/156] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:40.767680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:40.927350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb7729-5c44-49f6-8afc-182ce0d82c33 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.005454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c253784-a291-4acc-8d14-dafed0db0d04 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.016779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.017414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.017761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.018056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.112004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.113959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.119443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.120518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.121009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.121462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.122682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:41.123234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.126772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.158475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.162954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 78/157] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:41.170351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.244671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:41.254177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.330610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.378792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2051-392a-47d4-aa9f-1bcce35e7662 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.408235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469a539-45bb-4619-8835-ecf92fd8d904 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.428815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.443815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.444520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.444890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.445385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.446823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.448397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b5a9f-a09e-45e5-a158-a57a93dd05ff None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.450407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 81/159] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:41.451353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c7dfd-a5c3-4d99-8e8f-eb19c6ca0668 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.451630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c7dfd-a5c3-4d99-8e8f-eb19c6ca0668 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.451899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c7dfd-a5c3-4d99-8e8f-eb19c6ca0668 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.453543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 82/160] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:41.465383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.465668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.465964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.472326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.473148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.473306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.473521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.478790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.480284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.482325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 79/161] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:41.483151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.494021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:41.495319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:41.675059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 83/162] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:41.675975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:41.729914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449631a-1ccc-484e-9283-fe8d21868247 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.787306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.812721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.813356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.813638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.813940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:41.814687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=33f3999b36d7469f8f3b2c27f834129d) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:41.814994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:41.816496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:41.827891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 80/163] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/role_assignments?user.id=33f3999b36d7469f8f3b2c27f834129d&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:41.885707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c786-1ec9-45bb-9cbf-c2942fa1b4dc None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:41.922308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:41.933298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:41.933954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:41.934237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:41.934508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.031729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.033254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160721-9f18-47d6-a16c-049ec1ef013c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.166323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 84/164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:42.171869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.247934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58ff5-87a3-48a0-9a84-fa5375ce9baf None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.248335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58ff5-87a3-48a0-9a84-fa5375ce9baf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.248755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb58ff5-87a3-48a0-9a84-fa5375ce9baf None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.250398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 85/165] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:42.275494 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.275800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.276048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.319152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:42.320465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:42.370302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:42.442127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a5aae-2355-4433-a956-0ef323dfb3bd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.510123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.510958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.511245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.511517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.512728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:42.514472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:42.523540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 81/166] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:42.524549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.551522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 86/167] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:42.552218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:42.638494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:42.760790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b900e4c-c62d-4198-aa89-11519f122c46 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.857439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:42.858630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:42.859569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:42.860063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:42.884288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855212a9-5565-4cd0-8f73-4032d38a46e4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:42.894349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:42.912313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:42.914893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:42.916421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:42.917609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 82/168] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:42.928019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.000334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.001826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.002690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.003457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.005097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:43.005903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.009493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.036210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 87/169] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=f25e512661f54369b009eabe1c62d99a => generated 608 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:43.174561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c7a45-0e22-44e8-ad22-30b3f3936366 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.203376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.221184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.221821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.222142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.222393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.223091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:43.223405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.224855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.240109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:43.249781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.294314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.325917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.581083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d272-53a9-4e9c-aadc-8f87faea0b42 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.623158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c5e3-6547-4640-bd89-a5076cfe4fd0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:43.662247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.663378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.663883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.664449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.699440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-4daed441-af34-4c83-974b-f524d0a1c3c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:43.714680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:43.716410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:43.718813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 84/171] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:43.730715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274737b-573d-4cfd-ac13-13f816e16018 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.731245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274737b-573d-4cfd-ac13-13f816e16018 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.731728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274737b-573d-4cfd-ac13-13f816e16018 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.734960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 85/172] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:43.736330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274737b-573d-4cfd-ac13-13f816e16018 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:43.762699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:43.763373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.763659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.763918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.770732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:43.772909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7ebba-cff6-4fea-92d5-9c8c65a27867 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:43.775082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 88/173] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:43.776353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898360-7f00-4275-8d13-b5d8efc2b241 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:43.776761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898360-7f00-4275-8d13-b5d8efc2b241 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:43.776999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898360-7f00-4275-8d13-b5d8efc2b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:43.839105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c5898360-7f00-4275-8d13-b5d8efc2b241 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:43.840592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c5898360-7f00-4275-8d13-b5d8efc2b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:43.853123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:43.974253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274737b-573d-4cfd-ac13-13f816e16018 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.046751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.048237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.049004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.049658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.051018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:44.051829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.055930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.072902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 86/174] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:44.074890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.075805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 89/175] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:44.078326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bb4a-1daf-4458-b4de-f606c685d172 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.078962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bb4a-1daf-4458-b4de-f606c685d172 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.079458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823bb4a-1daf-4458-b4de-f606c685d172 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.082714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 90/176] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:44.091381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823bb4a-1daf-4458-b4de-f606c685d172 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.138379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.277449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f4a8-1a5b-4d95-85d5-a008c93765fd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.294362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.388079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.388601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.388883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.389148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.439852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823bb4a-1daf-4458-b4de-f606c685d172 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.516225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.518057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.520052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.520816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] PATH_INFO: `/v3/users/e3a5432fcc7e499a908cd3704cc3a622` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.523455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] RBAC: Authorizing `identity:get_user(user_id=e3a5432fcc7e499a908cd3704cc3a622)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.527637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c51db-6623-4e67-b942-650ee3ef2386 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.531143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 91/177] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/users/e3a5432fcc7e499a908cd3704cc3a622 => generated 275 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:44.534559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.535597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.536393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.566460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:44.567449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:44.598594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.601791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d511f-841a-41f1-b785-b163ca518411 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:44.680271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 92/178] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:44.682311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.708602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.810732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:44.812086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922699f-4c83-4cbc-a200-f0e46c610645 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.812379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922699f-4c83-4cbc-a200-f0e46c610645 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.812661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922699f-4c83-4cbc-a200-f0e46c610645 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.818111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 88/180] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:44.818111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922699f-4c83-4cbc-a200-f0e46c610645 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:44.824555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:44.856581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3eff4-22c4-4835-9ca6-6e2f797c935e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:44.901597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:44.902549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:44.902964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:44.903366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:44.989737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:44.992318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b473911-3543-4f0f-b7fb-81890f81929a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.014457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.031675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922699f-4c83-4cbc-a200-f0e46c610645 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.074244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.075234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.075729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.076171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.094567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2fe7f553-697b-44cd-ada4-dd22932adc23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:45.104354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:45.106187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:45.107846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 89/181] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:45.109206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68019-b3be-42fb-83d7-237d50c30866 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.109206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68019-b3be-42fb-83d7-237d50c30866 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.109206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68019-b3be-42fb-83d7-237d50c30866 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.111630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 90/182] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:45.113077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68019-b3be-42fb-83d7-237d50c30866 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.149693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 93/183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:45.151594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.151997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.152388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.179976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:45.181991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:45.217708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.273153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:45.274054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.276898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68019-b3be-42fb-83d7-237d50c30866 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.329509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.330371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.330781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.331179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] PATH_INFO: `/v3/projects/5f6e4110246c469583940b3e9f6f8549` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.332707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] RBAC: Authorizing `identity:get_project(project_id=5f6e4110246c469583940b3e9f6f8549)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.335561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.337749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 91/185] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/projects/5f6e4110246c469583940b3e9f6f8549 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.338632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.365034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.446437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9838-74ec-465c-914f-ab874731c8b7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.492897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbbe7e-4f95-426d-87f3-5597efcd738d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.507860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.508941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.509421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.509905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.512019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.514693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23510d9b-2d3a-4cd3-9874-dfdf1de48642 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.517952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 95/186] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.519803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.520094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.520553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.533215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.538348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.538970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.539248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.539519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.540275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:45.540576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.542303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.549023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:45.551020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:45.556966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 92/187] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.556966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.638080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 96/188] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:45.639322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.705089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.729178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4026a-88af-4142-9355-eae17ee9783d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.774277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.775069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.775540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.775910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.777480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.779229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.780247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25565ae-bbd3-4a78-9cde-711b4427b105 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:45.781090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.782427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.832597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:45.833218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:45.833492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:45.833762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:45.835174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=5f6e4110246c469583940b3e9f6f8549, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:45.835587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:45.837393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:45.853917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=5f6e4110246c469583940b3e9f6f8549&role.id=f25e512661f54369b009eabe1c62d99a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:45.853917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:45.885617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:45.958141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa41e3d-8ba8-4343-9304-8f9c5ae5a09b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.005168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.005939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.006226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.007044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.007737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.009284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.024183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346f14-d681-4b63-8095-3d2823687e02 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.047674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.077847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.078633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.079174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.079526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.097246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.099791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.101901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 98/191] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:45 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:46.102864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.167316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 94/192] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:45 2022] POST /identity/v3/users => generated 297 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:46.175810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.224552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241edc-7693-4594-b625-0e35746aad12 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.284074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.284744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.285015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.285287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.300191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:46.305958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:46.310415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 99/193] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:46.311261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.358553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e70a-703d-4093-a874-18b9567eaf84 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.365429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.389015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.418961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.419867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.420337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.420839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.422162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=e3a5432fcc7e499a908cd3704cc3a622) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:46.422162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.423602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.430887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 95/194] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/role_assignments?user.id=e3a5432fcc7e499a908cd3704cc3a622&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:46.432303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.505478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a79c0-13e7-4b3e-b37a-0533f7ed6f38 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.560128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.561314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.561932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.562682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.582821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:46.583522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad710c-99e0-4293-9b5f-76492f6c8673 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:46.588372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:46.589454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:46.590342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 100/195] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:46.591002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:46.637823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.638535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.638813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.639093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.732664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.779228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.782919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.820464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:46.828113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69daef-de6a-4273-a00d-d280dfbfd1df None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:46.919143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:46.921218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:46.921704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:46.922236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:46.923480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:46.924022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:46.926828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:46.947448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 101/196] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:46.949034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.030033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:47.032043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.183922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f567132-9b4c-43f3-ac83-e652ff1a5001 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.227340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.266101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.266101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.266101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.266101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.267650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:47.268230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.271329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.280101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2aaed-204a-47cd-b79b-ab07cc61a0dc None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.284185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 102/198] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.284185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.300190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.342688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.344238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.344971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.345438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.347924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.351548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.354405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 97/199] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.355895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.411268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76e78-0fdb-48c9-96c4-1574c9fbed98 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.454083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.454742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.455099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.455658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.456894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.458694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.460603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 103/200] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.466589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.538940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148214-5a64-47a2-9ef5-4c11593af56e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.563693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.592322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfd9bd-c791-48ad-a641-f68d502f91fe None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.602010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.603617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.604387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.605110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] PATH_INFO: `/v3/users/67004177578d455ca8140015c5fc8a44` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.607469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] RBAC: Authorizing `identity:get_user(user_id=67004177578d455ca8140015c5fc8a44)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.610599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.613827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 98/201] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/users/67004177578d455ca8140015c5fc8a44 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.616132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.632762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.633413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.633690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.634003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.654255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.717444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.719024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.811591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa3b13-61ea-4b02-9874-d61ac6c7ef4a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:47.814237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:47.840104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 104/202] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:47.841193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:47.877648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:47.879134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:47.879906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:47.880623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:47.884126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=7eab5769100c477b8d2aa4b5ad42e19c) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:47.885053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:47.888203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:47.900067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 99/203] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/role_assignments?user.id=7eab5769100c477b8d2aa4b5ad42e19c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:47.901953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.051152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47739271-f13b-480d-bcbf-f7d5a87a8727 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.105086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.122755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.123645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.123924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.124199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.130955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f296f-8aee-4be2-b6ec-a5d9f2b14729 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.172126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.172862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.173207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.173494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.174879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.176423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.178643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 100/204] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:48.187961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.318528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629f6e9-74e9-43cf-8d40-943dad2bc47c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.320064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.360417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.361212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.361502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.361783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.362574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=7eab5769100c477b8d2aa4b5ad42e19c) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:48.363064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.369923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.371566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 101/205] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/role_assignments?user.id=7eab5769100c477b8d2aa4b5ad42e19c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:48.419692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.422696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.654006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 105/206] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 813 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:48.659447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:48.692185 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:48.899905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cc605-9470-4b59-a866-d8cc7a9273ea None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:48.979979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:48.981085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:48.981577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:48.982075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:48.987366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:48.990077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec55af7-0bc3-406d-9eb1-a59455a7796a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:48.994183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 102/207] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:49.001178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:49.197306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.207905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef526-adec-4d57-a28e-bfc600a930df None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.208539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef526-adec-4d57-a28e-bfc600a930df None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.209040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bef526-adec-4d57-a28e-bfc600a930df None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.211370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 103/208] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 19:59:49.220126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.221362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.221843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.243596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac340bd6-808c-4f8c-a456-96c158508eaf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:49.267697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:49.269052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:49.313778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:49.315975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.316805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.321948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.321948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, scope.project.id=c5e82a31982b40a5bafc35cb91478a00, user.id=67004177578d455ca8140015c5fc8a44) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:49.321948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:49.321948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e917e1-0cc7-4672-a1fb-057ae3f045b9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:49.340492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 106/209] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:48 2022] GET /identity/v3/role_assignments?user.id=67004177578d455ca8140015c5fc8a44&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=fb37488e6c8844d493ae349bead65655 => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:49.343517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d1579-2090-4f83-bd7a-1af7e7a958a7 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.344229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d1579-2090-4f83-bd7a-1af7e7a958a7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.344896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d1579-2090-4f83-bd7a-1af7e7a958a7 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.347988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 107/210] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:49.358551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.359349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.360180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.363247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 104/211] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:49.385812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:49.387208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:49.504475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 19:59:49.767828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:49.790355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:49.903498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562749-9e75-42f2-a9b3-c29365b41e7f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:49.945162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:49.951521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:49.951521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:49.951819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:49.952041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:49.953230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:49.954748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:49.956396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:49.966271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.048107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.082878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.088346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135da9b-9f27-4430-8990-56eb9af7bba1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.098680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08143ea-9c77-42fc-84ca-4f03100f5ca0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.137491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.138731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.139131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.139520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.144525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.145414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.146177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.147237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.148110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.150785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.153872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:50.159009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:50.166858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:50.167844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:50.169745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.301199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 106/215] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:49 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 19:59:50.303912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f05b9-ac47-449f-afa2-ddd14dc96fa3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.346219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.352754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.353401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.353741 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.354067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.354863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:50.355236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.356804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.368065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 110/216] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:50.374138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.505228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db3660-e9c7-4871-a7bd-03454081398f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.551608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.552607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.553654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.554343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] PATH_INFO: `/v3/users/fa92c862cd8b46a099047913d4f1590b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.566147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.572834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] RBAC: Authorizing `identity:get_user(user_id=fa92c862cd8b46a099047913d4f1590b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.574708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c402-361b-4ed0-9b37-2ed16fece49e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:50.576663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 107/217] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/users/fa92c862cd8b46a099047913d4f1590b => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:50.582577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:50.730239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69e536-e172-40e3-9964-8bc219210417 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:50.799070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:50.800426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.801125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.801547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.822482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabc8-42f7-4f86-830e-9ef513024d24 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.822855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabc8-42f7-4f86-830e-9ef513024d24 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.823312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddabc8-42f7-4f86-830e-9ef513024d24 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.826014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 108/218] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:50.833734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:50.834732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:50.835649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:50.876787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:50.879780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:50.913713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:50.922276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:50.923798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.038032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:51.038963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:51.049483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.206539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adb86f-5a10-43d7-b9f0-514e25086a33 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.237112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.251319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.251989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.252276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.252555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.254069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:51.260326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.260326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:51.271625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.450010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.483319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.505715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a70fb8-393d-450e-90b9-5d48f541b19d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.576949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83f716-e589-4469-9a22-f0d45cc58ce2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.610677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.612036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.612771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.613534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.614831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=fa92c862cd8b46a099047913d4f1590b) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:51.615789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:51.617181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320916f8-6ecc-47a4-a19c-08bc95e78350 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.624186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.625674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.626479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.627247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.630041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 112/222] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/role_assignments?user.id=fa92c862cd8b46a099047913d4f1590b&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=f25e512661f54369b009eabe1c62d99a => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:51.632539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe4c3c-91e4-4e24-a3a9-7164f469811c None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.632818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe4c3c-91e4-4e24-a3a9-7164f469811c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.633258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe4c3c-91e4-4e24-a3a9-7164f469811c None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.635365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 113/223] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:51.641703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949823-97b6-495d-920d-194be899b018 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.642021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949823-97b6-495d-920d-194be899b018 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.642298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949823-97b6-495d-920d-194be899b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.658277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:51.667884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:51.668861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:51.669643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:51.670300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 111/224] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:51.682994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-27949823-97b6-495d-920d-194be899b018 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:51.684731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-27949823-97b6-495d-920d-194be899b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:51.688369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:51.825814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:51.862059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 114/225] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:51.898136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9723-0125-43d3-8bb7-faba7e1b9a1e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:51.945615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:51.946638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:51.947126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:51.947652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:51.948715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:51.949238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:51.950926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:51.961345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 112/226] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:51.967781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949823-97b6-495d-920d-194be899b018 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.103772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.123940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949823-97b6-495d-920d-194be899b018 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.160868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.204790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.206096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.207484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.207484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.209385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.218704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.225941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 115/227] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:51 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:52.240928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.290334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33104f3-cfd2-476b-a160-5ebfa8a41705 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.308228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.340021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.341032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.341555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.342584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.368609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:52.374791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:52.375712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:52.376546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:52.382702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 113/228] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:52.391339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.509237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b253b2-0c6d-4cd5-96c9-3edf90b8ba51 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.580267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.581448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.581986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.582656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.591669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.594248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021ab77-d7d4-4f5f-946a-79102aaa7c0c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.594737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.597967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 116/229] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:52.606417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.658188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.661059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.661358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.661599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.663207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:52.666315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.667813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.669535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.692882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 114/230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:52.702103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:52.782443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:52.828327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f455d6-e74b-449a-b897-00cd6c7ea27e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.900407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.901093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.901372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.901654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/7eab5769100c477b8d2aa4b5ad42e19c/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.903892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, user_id=7eab5769100c477b8d2aa4b5ad42e19c, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:52.905462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:52.917572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf351-4ea4-46da-962c-bc117ef35672 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:52.988535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 117/231] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:52 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/7eab5769100c477b8d2aa4b5ad42e19c/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:52.989609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:52.991313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:52.991847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:52.992328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:52.999452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.002472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.006355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 115/232] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:52 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 19:59:53.013060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:53.206200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.225919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbc00-d482-45bc-8142-6515ad6ec112 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:53.270491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:53.271171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.272166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.272447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.274032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.275619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e29197-4ee2-4b0c-a1f8-98b1f8a883c0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.278038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 118/233] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:53 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:53.285436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:53.464141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab1044-c5ca-4599-b82e-f0b2cb057beb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:53.469734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:53.512867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:53.513548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.513830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.514134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/7eab5769100c477b8d2aa4b5ad42e19c/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.519833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, user_id=7eab5769100c477b8d2aa4b5ad42e19c, role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:53.521357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20f188-61f2-4865-ada6-62a0d5af5e84 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:53.630359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 116/234] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:53 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/7eab5769100c477b8d2aa4b5ad42e19c/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 19:59:53.984575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d542a-903b-49f3-b4e2-88ad6124d171 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.986183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d542a-903b-49f3-b4e2-88ad6124d171 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.986932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d542a-903b-49f3-b4e2-88ad6124d171 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:53.989673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 119/235] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:53.996887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393751c-b2e3-4cc2-b385-5d901d73e012 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:53.997394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393751c-b2e3-4cc2-b385-5d901d73e012 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:53.998188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393751c-b2e3-4cc2-b385-5d901d73e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.047747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9393751c-b2e3-4cc2-b385-5d901d73e012 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:54.049857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9393751c-b2e3-4cc2-b385-5d901d73e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:54.163538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 117/236] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:54.186011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764684b-ba39-4b66-b14c-31df2fdf064e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.186440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764684b-ba39-4b66-b14c-31df2fdf064e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.186890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764684b-ba39-4b66-b14c-31df2fdf064e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.189716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 120/237] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:54.195510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d75aa-242f-41d9-9fa3-c095e6bf3de1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.195793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d75aa-242f-41d9-9fa3-c095e6bf3de1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.196060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d75aa-242f-41d9-9fa3-c095e6bf3de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.217544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8a4d75aa-242f-41d9-9fa3-c095e6bf3de1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:54.218788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8a4d75aa-242f-41d9-9fa3-c095e6bf3de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:54.336646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:54.483765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c693-69ec-4dcb-8588-f1c75d832500 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.484140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c693-69ec-4dcb-8588-f1c75d832500 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.484422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c693-69ec-4dcb-8588-f1c75d832500 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.486633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 121/239] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:54.493162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.493446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.493712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.518968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:54.520122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:54.548909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:54.578065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c693-69ec-4dcb-8588-f1c75d832500 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:54.635808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 119/240] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:54.686682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:54.893499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c693-69ec-4dcb-8588-f1c75d832500 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:54.957747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53631230-a675-4e32-91e9-f1baec5c73a1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:54.967859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:54.969325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:54.970058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:54.970724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:54.972963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:54.976424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:54.979938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 122/241] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:54.981899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.010737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.011550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.011891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.012292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.027541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:55.029792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:55.034013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:55.035978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 120/242] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:55.039500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.086351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.183560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a8db3-8c81-4539-b8c3-658cd99e201c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.274579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603da13f-6008-4485-92b4-1ee180c393e3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.274806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.275369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.275650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.275925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.296166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:55.305841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:55.306853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:55.307658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:55.317631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 123/243] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:55.319168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.322326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.323389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.323880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.324444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.325305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.327039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.424086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 121/244] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 19:59:55 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 19:59:55.425285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.451166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.485843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23562e-a415-4f27-bca0-7024ffee9bc8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.528134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.529197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.529732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.530238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.531178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:55.531730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.533561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.546111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 124/245] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:55.552150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.628593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.748090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa3579-7f21-4839-98f0-ad2b4d8f8fa3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.754724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b590e2-3540-4554-8bdf-c474a80fb153 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:55.798627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.799747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.800231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.800718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.801605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:55.802667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.804329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234514-c206-4015-9ebf-7880eedd0f25 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.824693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 122/246] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:55.826436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5001f-626c-42be-a00b-c707ca0c4194 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.826939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5001f-626c-42be-a00b-c707ca0c4194 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.827621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5001f-626c-42be-a00b-c707ca0c4194 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.829208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 123/247] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:55.830503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5001f-626c-42be-a00b-c707ca0c4194 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:55.847915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:55.848560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.848856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.849191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] PATH_INFO: `/v3/users/913709d726c0433eb748450a8a0eea45` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.889645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:55.895539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] RBAC: Authorizing `identity:get_user(user_id=913709d726c0433eb748450a8a0eea45)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:55.900911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa16a9e-c1de-4927-8b37-0f0dbdcd2841 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:55.904792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:55 2022] GET /identity/v3/users/913709d726c0433eb748450a8a0eea45 => generated 297 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:55.907314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:55.908088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:55.908795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:55.968315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:55.970964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:56.014420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5001f-626c-42be-a00b-c707ca0c4194 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:56.072339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:56.078508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:56.079182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 126/249] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:56.079610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.079610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.079768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] PATH_INFO: `/v3/users/fa92c862cd8b46a099047913d4f1590b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.080595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.080896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] RBAC: Authorizing `identity:get_user(user_id=fa92c862cd8b46a099047913d4f1590b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:56.082452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:56.084325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 124/250] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:55 2022] GET /identity/v3/users/fa92c862cd8b46a099047913d4f1590b => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:56.090664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.344080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12618c45-1392-46c2-b140-ff5f71439303 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:56.400274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80312b0-7688-4e5d-bee4-bc2c5e26f005 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:56.410298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:56.422865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:56.423849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.424345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.425494 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.491742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:56.492399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.492678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.492948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.498706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:56.500193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:56.502316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 125/251] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:56.508250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.571416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:56.574721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:56.639762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:56.712346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd045-4c0f-448d-986a-8878b0e3338e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:56.751524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:56.752276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.752485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.752764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/fa92c862cd8b46a099047913d4f1590b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.754778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, user_id=fa92c862cd8b46a099047913d4f1590b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:56.756553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f911271-0667-473d-890c-fe9ea71db4fa None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:56.789613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 127/252] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:56.791205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.821259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 126/253] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 19:59:56 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/fa92c862cd8b46a099047913d4f1590b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 19:59:56.824114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff6fb8-7e2a-4079-af3a-0862d60d670a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:56.824611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff6fb8-7e2a-4079-af3a-0862d60d670a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:56.825119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff6fb8-7e2a-4079-af3a-0862d60d670a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:56.827803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 127/254] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:56.829524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff6fb8-7e2a-4079-af3a-0862d60d670a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:56.846248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.006875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77157dac-7e27-4f50-beb7-b9b0e07a6388 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.067643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.069397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.069676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.069991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.085428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-9625734d-7254-4d4e-8216-8bbebf08be50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:57.091422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:57.092367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 19:59:57.093155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:57.095874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 128/255] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 19:59:57.097481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.097692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff6fb8-7e2a-4079-af3a-0862d60d670a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.098273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.098745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.120346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:57.121987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:57.166910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.181895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.183170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.183679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.184321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.186460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.189687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.197938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 128/256] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:56 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:57.197938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.228687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 129/257] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:57.233187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.326597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.487691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646b3e-2506-466f-af1c-e2331b8831bb None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.492228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2832b3-f620-4ab3-b7ff-c821a6d43201 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.573076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.574030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.574496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.574970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.576095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:57.576553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.578978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.597254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 129/258] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:57.602853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.603505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.603792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.604064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.604831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=913709d726c0433eb748450a8a0eea45) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:57.605140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.608877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.609969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.616717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 130/259] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/role_assignments?user.id=913709d726c0433eb748450a8a0eea45&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=fb37488e6c8844d493ae349bead65655 => generated 259 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:57.715885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.733497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.780444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37787d6b-bb6c-417f-be77-289ebc0438f5 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.870183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.870837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.871119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.871394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:57.878923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:57.881181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:57.882962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 130/260] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:57.888968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:57.919744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:57.939547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd40fb-741d-45f7-a10f-6cb0946f5e70 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:57.986974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:57.987632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:57.987913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:57.988246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.029552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:58.048751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:58.050424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 19:59:58.051996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:58.057635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 131/261] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:58.066528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:58.206209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d785e7-e52b-4612-84a1-99f601881007 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:58.270268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:58.282536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:58.283203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.283486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.283760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.344026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b51f-bf7b-410d-bde7-cc53a6fdb1c4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:58.399327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:58.399973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.400321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.400602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.401355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:58.401668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:58.403219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:58.416692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 132/262] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 19:59:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:58.419129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:58.420865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:58.422545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:58.435724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:58.546481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 131/263] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 19:59:58.555045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:58.606235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:58.657237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9450d7-b5c4-4d05-b10c-8959b8901344 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:58.696540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:58.697212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.697474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.697748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] PATH_INFO: `/v3/users/7eab5769100c477b8d2aa4b5ad42e19c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.698993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] RBAC: Authorizing `identity:get_user(user_id=7eab5769100c477b8d2aa4b5ad42e19c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:58.700620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c12b9-2461-4845-b167-d73026995c3d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:58.702388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 133/264] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:58 2022] GET /identity/v3/users/7eab5769100c477b8d2aa4b5ad42e19c => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:58.703687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb30be-0a7b-496e-9808-dcb8d3988650 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.703971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb30be-0a7b-496e-9808-dcb8d3988650 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.704245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb30be-0a7b-496e-9808-dcb8d3988650 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.705493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 134/265] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:58.711678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb30be-0a7b-496e-9808-dcb8d3988650 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:58.749294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de5fe8-edd7-412a-a5a9-7e9ba1cb8ad1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:58.819862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:58.820633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.820816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.821094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.826274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:58.827550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:58.829215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3fffe-aca8-482e-b1eb-cb3dba43b4db None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:58.831536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:58 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:58.833104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.833968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.834251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:58.867101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb30be-0a7b-496e-9808-dcb8d3988650 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:58.874428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:58.878368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:58.934678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:58.935325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:58.935609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:58.935885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.002319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 133/267] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:59.003258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.047508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.062754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.064290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:59.194847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cca79-6ecd-460c-81a7-f48e31025c05 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.270058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.271620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.272125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.272667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.273604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=7eab5769100c477b8d2aa4b5ad42e19c) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:59.275412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.277217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4686a9b-f0c1-4147-bf91-2628942498bd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:59.291114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.300977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 134/268] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/role_assignments?user.id=7eab5769100c477b8d2aa4b5ad42e19c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:59.304766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a0ad-7920-4ec2-ba83-d55853b5c90d None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.305237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a0ad-7920-4ec2-ba83-d55853b5c90d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.305721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a0ad-7920-4ec2-ba83-d55853b5c90d None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.309474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 135/269] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:59.320482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.320975 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.321456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.328001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 135/270] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 19:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 19:59:59.344930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.367798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:59.369749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:59.525348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 136/271] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 19:59:59.527116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.537691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9da971-d768-4ab7-9b94-076e7dfe2fab None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.572918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.577429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.578449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.578947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.579408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.593917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 19:59:59.600329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 19:59:59.601291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 19:59:59.602122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 19:59:59.604889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 136/272] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 19:59:59.610523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.687155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.755825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd25b60-953d-41d4-bb61-0f56f04c2f6d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.763395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68874d28-a306-4c28-ba79-28fd1dd6930a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 19:59:59.804101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.804655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.804937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.805208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.805914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 19:59:59.806232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.807725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba40b48-01b5-4271-b6f0-d4b11a0f4d52 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:59.825278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 137/273] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:59.826829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4ede-e27d-4d3d-94fe-a7f5817067e1 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.827123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4ede-e27d-4d3d-94fe-a7f5817067e1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.827401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4ede-e27d-4d3d-94fe-a7f5817067e1 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.828917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 19:59:59.829393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 138/274] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 19:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 19:59:59.829860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4ede-e27d-4d3d-94fe-a7f5817067e1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 19:59:59.830078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.830579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.831067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.833212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 19:59:59.836220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d47ba-45b6-4804-bbaa-74ef894864a3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 19:59:59.843831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 137/275] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 19:59:59.846361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 19:59:59.846863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 19:59:59.847401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 19:59:59.889333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 19:59:59.891680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 19:59:59.969773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:59:59.978721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4ede-e27d-4d3d-94fe-a7f5817067e1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.022302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.022933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.023218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.023506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] PATH_INFO: `/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.031296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 138/276] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 19:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:00.033386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.048469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] RBAC: Authorizing `identity:get_user(user_id=7b8f4c8e209d4913bb9c56e8cd05aabd)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.050374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.053436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 139/277] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 19:59:59 2022] GET /identity/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:00.054649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.074569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.204575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1548f-e73c-4911-9afd-a7423af9759f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.245376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609a3d-c36a-4ee0-b9ec-8c4c28cd29f2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.256556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.256556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.256556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.256556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.257094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.260266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.260266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 140/278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:00.260806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.299841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.332801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.334839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.335573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.336257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.338029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=7eab5769100c477b8d2aa4b5ad42e19c) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:00.338532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.341131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.349759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 139/279] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/role_assignments?user.id=7eab5769100c477b8d2aa4b5ad42e19c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:00.351409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.460866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4b06-5ed3-4803-a281-6c1bf3cbc6e7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.504517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.526317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.527277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.527736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.528187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.529464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, user.id=7b8f4c8e209d4913bb9c56e8cd05aabd, scope.system=all) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:00.530003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.532488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.534244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f4cda-a230-43b4-afbd-5b15f7293327 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.542092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 141/280] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/role_assignments?user.id=7b8f4c8e209d4913bb9c56e8cd05aabd&scope.system=all&role.id=f25e512661f54369b009eabe1c62d99a => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:00.543219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.592608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.593149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.593427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.593698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.594412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:00.595957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6e123-44a7-4ceb-850b-5b081997d562 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:00.687943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:00.706082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e885-c071-47af-9699-173f70a8fa34 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:00.718030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 140/281] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:00 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:00.719348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8947acc-f91a-4482-81e3-acc5f7dce5df None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.721663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8947acc-f91a-4482-81e3-acc5f7dce5df None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.721663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8947acc-f91a-4482-81e3-acc5f7dce5df None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.722518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 141/282] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:00.730945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.731215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.731518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.764575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:00.765238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:00.765514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:00.765784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:00.768784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:00.772443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:00.782489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:00.793454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:00.795151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:00.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:00.799957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 142/283] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:00.801848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:00.894026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 142/284] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:00.985554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d770d-e1c6-4886-9676-b4ae7dcef0fe None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.049701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.050751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.051235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.051770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.052994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:01.053521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:01.056220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:01.071474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 143/285] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:01.077313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.209923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.280905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077eb72-ea50-4eb7-a65f-fcb5a7735e7b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.316667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.342364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.353950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.355030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.355507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.355967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] PATH_INFO: `/v3/users/fa92c862cd8b46a099047913d4f1590b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.358470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] RBAC: Authorizing `identity:get_user(user_id=fa92c862cd8b46a099047913d4f1590b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:01.361863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:01.365197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 143/286] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/users/fa92c862cd8b46a099047913d4f1590b => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:01.375550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.535750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55031f0a-b771-4b3a-80f2-62b5c485b8b3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.594637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b238-7b9e-48ba-af5f-4fb02fbf8562 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:01.606853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.607964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.608474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.608932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.656602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:01.669197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:01.670216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:01.671504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 144/287] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:01.683638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:01.704414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:01.705853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:01.706672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:01.707412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:01.713077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.903735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:01.934823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:01.937530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.026651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fab38-9cc2-426a-92dc-241d3e49f9dd None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.157092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.158068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.158578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.159078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.160269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:02.163897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.166728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.208688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 145/288] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.222830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.306699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 144/289] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 932 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:02.314023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.384148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.536603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed40243-a9b7-401d-9a2d-ad9a01f1ff05 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.578647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50cc91-5091-45ff-bc3a-04dc4e0836bf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.647289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.665988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.667082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.667562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.668045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] PATH_INFO: `/v3/users/913709d726c0433eb748450a8a0eea45` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.673088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] RBAC: Authorizing `identity:get_user(user_id=913709d726c0433eb748450a8a0eea45)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.675905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.687522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 146/290] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/users/913709d726c0433eb748450a8a0eea45 => generated 297 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.689121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.716188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.717619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.717619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.717619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.720372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.721867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.724607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 145/291] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.730371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:02.907823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e14706-ed01-4681-83e5-10feb063d57f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.973243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ef26a-fae4-43cd-9a52-35fa01fafbd9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:02.975855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:02.976705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:02.978313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.979043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.979701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:02.982146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:02.985259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7ab8b-609b-4125-a637-993dda2a9fff None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:02.988946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 147/292] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:02.996499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32c44-69a9-4407-bb39-7924eb20c91d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:02.996499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32c44-69a9-4407-bb39-7924eb20c91d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:02.997738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca32c44-69a9-4407-bb39-7924eb20c91d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.001668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 148/293] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:03.009230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2e3b-4456-4f95-8d71-39a45f44484f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.011597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2e3b-4456-4f95-8d71-39a45f44484f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.012551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e2e3b-4456-4f95-8d71-39a45f44484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.015868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.016610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.016987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.017358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.018246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=fa92c862cd8b46a099047913d4f1590b) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:03.018651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.020455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.028676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:02 2022] GET /identity/v3/role_assignments?user.id=fa92c862cd8b46a099047913d4f1590b&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=f25e512661f54369b009eabe1c62d99a => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:03.028934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.049558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d99e2e3b-4456-4f95-8d71-39a45f44484f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:03.052654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d99e2e3b-4456-4f95-8d71-39a45f44484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:03.155934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc63b-1cee-497a-a98c-0537c0e19ff1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.191215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.197282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 149/295] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:03.199764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af400-8be7-419c-a16f-86bb08da52d4 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.200436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af400-8be7-419c-a16f-86bb08da52d4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.201064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af400-8be7-419c-a16f-86bb08da52d4 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.203547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 150/296] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:03.213429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.213429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.213429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.218712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.219633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.220020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.220366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/913709d726c0433eb748450a8a0eea45/roles/fb37488e6c8844d493ae349bead65655` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.230878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, user_id=913709d726c0433eb748450a8a0eea45, role_id=fb37488e6c8844d493ae349bead65655)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.232528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:03.233132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:03.234739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:03.343105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 147/297] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:03 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/users/913709d726c0433eb748450a8a0eea45/roles/fb37488e6c8844d493ae349bead65655 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:03.388592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:03.509973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.545195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.649452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85eccb-56c3-406b-b226-d8d0d3c89acf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.691491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.692245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.693022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.693296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.705953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:03.711064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:03.712725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:03.714206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 148/299] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:03.720059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.906580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c11792-5ee1-4d9b-8c4f-3f6720d698b6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:03.934756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:03.958478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:03.976862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:03.978092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:03.979025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:03.979485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:03.980975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:03.981471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:03.984589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f2efa-8485-4ffd-9edd-4bdeb3485616 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.000046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 152/300] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:04.001332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e4a-728d-47a7-aab9-ac9d0b2b188f None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.001616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e4a-728d-47a7-aab9-ac9d0b2b188f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.001906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f8e4a-728d-47a7-aab9-ac9d0b2b188f None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.003471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 153/301] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:04.007935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8e4a-728d-47a7-aab9-ac9d0b2b188f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.080158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.097812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12381831-4371-4ff0-8e21-3775c831ad07 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.143300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.143608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f8e4a-728d-47a7-aab9-ac9d0b2b188f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.143939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.144222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.144495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.158263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-48f6b8bb-8a8c-4b1e-bf71-e175c272b731 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:04.164057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:04.164962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:04.165766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 149/302] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:04.167270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.167270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.167270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.190632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.191335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.191619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.191897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] PATH_INFO: `/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.193797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:04.194470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] RBAC: Authorizing `identity:get_user(user_id=7b8f4c8e209d4913bb9c56e8cd05aabd)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.195370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:04.195966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.197651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 154/303] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:04.198467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.289760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.307461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 150/304] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:04.314904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.347125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61d7a3-1c9d-4b90-a516-d92009c9148b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.403243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.403927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.404212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.404491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.405167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:04.405474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.406923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.424924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 155/305] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.426676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.446013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.476637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d716a7-4ef6-4899-acf8-8a55b7b6bacd None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.519409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.520618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.521122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.521600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] PATH_INFO: `/v3/system/users/7b8f4c8e209d4913bb9c56e8cd05aabd/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.523480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b8f4c8e209d4913bb9c56e8cd05aabd, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.525180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.607084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 151/306] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Aug 17 20:00:04 2022] PUT /identity/v3/system/users/7b8f4c8e209d4913bb9c56e8cd05aabd/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:04.646582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be18ae-64b2-4341-be39-1d4e4b1facf6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.680976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:04.700114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.719200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.720349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.721211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.721495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] PATH_INFO: `/v3/users/69d250ebabd14acea78d561c648eb543` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.750755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] RBAC: Authorizing `identity:get_user(user_id=69d250ebabd14acea78d561c648eb543)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.753799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.757669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 156/307] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/users/69d250ebabd14acea78d561c648eb543 => generated 293 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:04.767010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.893788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16ceb-2606-4e2a-b1fa-97eb50dc9e57 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.945663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:04.946385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:04.946736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:04.947080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:04.949547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:04.951520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:04.958978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 152/308] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:04.960889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:04.968844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdc7e-63f8-461d-8193-4e4f88dd41b8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:04.990479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:05.010669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.011301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.011581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.011851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.012598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, user.id=69d250ebabd14acea78d561c648eb543, scope.system=all) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:05.012901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:05.014512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410052e5-6a8e-4526-a910-dde40da9268d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.026038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 157/309] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 17 20:00:04 2022] GET /identity/v3/role_assignments?user.id=69d250ebabd14acea78d561c648eb543&scope.system=all&role.id=fb37488e6c8844d493ae349bead65655 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:05.097274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7cc26-00b3-4f09-9921-782e94fd4b83 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:05.143335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:05.144434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.144942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.145999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] PATH_INFO: `/v3/groups` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.146886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:05.148716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bac8f-383b-4fa7-b3f0-82584825b52b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:05.224179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 153/310] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Aug 17 20:00:04 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:00:05.556470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94136-0050-4f66-b206-659e6cb164b9 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.556819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94136-0050-4f66-b206-659e6cb164b9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.556919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b94136-0050-4f66-b206-659e6cb164b9 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.558679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 158/311] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:05.564318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2946-175c-47cc-a991-611a8237b228 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:05.564603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2946-175c-47cc-a991-611a8237b228 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:05.564861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2946-175c-47cc-a991-611a8237b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:05.585497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-788d2946-175c-47cc-a991-611a8237b228 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:05.586765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-788d2946-175c-47cc-a991-611a8237b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:05.660471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:05.669902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 154/312] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:05.950303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94136-0050-4f66-b206-659e6cb164b9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:05.998169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.065370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b94136-0050-4f66-b206-659e6cb164b9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.106802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.107734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.108162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.108571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.122251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:06.127372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:06.128471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:06.130112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:06.133857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 159/313] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:06.143450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2946-175c-47cc-a991-611a8237b228 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.259081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d2946-175c-47cc-a991-611a8237b228 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.297734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.298381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.298655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.298968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.299595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:06.299882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.301871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.311795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 155/314] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:06.317603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.434420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.438041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10067d-3416-4982-b92a-2b4748d230aa None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.478882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.479535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.479812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.480084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] PATH_INFO: `/v3/users/913709d726c0433eb748450a8a0eea45` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.481266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] RBAC: Authorizing `identity:get_user(user_id=913709d726c0433eb748450a8a0eea45)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.482816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.484550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 160/315] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/users/913709d726c0433eb748450a8a0eea45 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:06.491127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.561832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.608529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612916d6-e0c9-4caa-a2bc-08cc0bd6431a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:06.647972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:06.648594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:06.648869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:06.649131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:06.733983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:06.735522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:06.803800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:06.860431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 156/316] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:06.866055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:06.983029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61649f-0127-485f-b7cf-a82ef5154bec None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:07.025252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:07.025919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.026180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.026462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.027715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:07.029281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e3ae4-9110-4a96-b8c3-d292aee594c4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:07.030974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 161/317] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:06 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:07.037656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:07.124037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80dea-01a4-456f-9037-b4f8aba882ca None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.124459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80dea-01a4-456f-9037-b4f8aba882ca None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.124459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd80dea-01a4-456f-9037-b4f8aba882ca None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.125824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 162/318] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:07.132547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14ffc-73f5-42fe-863b-9032647887ba None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.132947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14ffc-73f5-42fe-863b-9032647887ba None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.133186 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c14ffc-73f5-42fe-863b-9032647887ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.159037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c37c67-1bdc-4132-b1cb-7b0571238940 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:07.160358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b9c14ffc-73f5-42fe-863b-9032647887ba None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:07.163636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b9c14ffc-73f5-42fe-863b-9032647887ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:07.204162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:07.208357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:07.209165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.209577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.210172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.213540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, scope.project.id=bb674ad817d64501aa0c850044dd08c3, user.id=913709d726c0433eb748450a8a0eea45) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:07.213540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:07.214159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960214e-39c8-482b-97e9-321b8af12cfe None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:07.226337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 157/319] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:07 2022] GET /identity/v3/role_assignments?user.id=913709d726c0433eb748450a8a0eea45&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=fb37488e6c8844d493ae349bead65655 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:07.263198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 163/320] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:07.470036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b568-7ac4-49e2-ae97-9aa54165b861 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.470422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b568-7ac4-49e2-ae97-9aa54165b861 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.470626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32b568-7ac4-49e2-ae97-9aa54165b861 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.471977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 158/321] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:07.480031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.480403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.480755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.499906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:07.501180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:07.543191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32b568-7ac4-49e2-ae97-9aa54165b861 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:07.573452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:07.576118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 164/322] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:07.656689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32b568-7ac4-49e2-ae97-9aa54165b861 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:07.691544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:07.692884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.693168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.693440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.704605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:07.710719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:07.711628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:07.712625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 159/323] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:07.717769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:07.823982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:07.830538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b456-f5cd-4ebc-9c6e-56f17602c6c0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:07.850737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:07.867237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:07.867859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:07.868137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:07.868404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:07.869098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:07.869388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:07.870796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:07.885351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 165/324] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:07.887350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:07.947258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:07.964610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549ca02-c3db-414f-aa20-519cb6f63280 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.002459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.003104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.003385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.003656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.007024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cca6b-4270-4e16-a90f-a24ee667f72b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.015188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:08.021177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:08.022196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:08.023037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 160/325] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:08.028610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.054677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.055328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.055602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.055870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] PATH_INFO: `/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.057034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] RBAC: Authorizing `identity:get_user(user_id=7b8f4c8e209d4913bb9c56e8cd05aabd)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.058572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.060177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 166/326] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:07 2022] GET /identity/v3/users/7b8f4c8e209d4913bb9c56e8cd05aabd => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:08.066023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.097161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:08.145370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143dc4-5191-4351-a36f-c1d1a8dae9f8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.180290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9627bde-d9bf-41cf-a235-b65411aa9148 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.182113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.182733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.183012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.183285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.183956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:08.184260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.185663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.195464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 161/327] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:08.200868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.211218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:08.218471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.219093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.219377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.219656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.220395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] RBAC: Adding query filter params (role.id=f25e512661f54369b009eabe1c62d99a, user.id=7b8f4c8e209d4913bb9c56e8cd05aabd, scope.system=all) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:08.220795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.222212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.235226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 167/328] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 17 20:00:08 2022] GET /identity/v3/role_assignments?user.id=7b8f4c8e209d4913bb9c56e8cd05aabd&scope.system=all&role.id=f25e512661f54369b009eabe1c62d99a => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:08.324676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e480e-c2b0-4bc3-a7c7-027c1cf766dc None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.363287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.364510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.364988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.365368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] PATH_INFO: `/v3/users/69d250ebabd14acea78d561c648eb543` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.366703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] RBAC: Authorizing `identity:get_user(user_id=69d250ebabd14acea78d561c648eb543)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.368194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef4e6-e307-4bf6-a5e2-08dd1f2f2633 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.370125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 162/329] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:08 2022] GET /identity/v3/users/69d250ebabd14acea78d561c648eb543 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:08.375995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.397260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3a0d-bd6b-4c7a-9218-b2ab1faaea0b None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.397808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3a0d-bd6b-4c7a-9218-b2ab1faaea0b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.398109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c3a0d-bd6b-4c7a-9218-b2ab1faaea0b None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.399472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 163/330] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:00:08.408224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.408486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.408767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.432989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:08.435318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:08.484139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:08.501898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740db21-0ea3-4a72-945b-2d4592b3780f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.537923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 164/331] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:08.539473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.540150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.540434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.540713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] PATH_INFO: `/v3/system/users/69d250ebabd14acea78d561c648eb543/roles/fb37488e6c8844d493ae349bead65655` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.542203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=69d250ebabd14acea78d561c648eb543, role_id=fb37488e6c8844d493ae349bead65655)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.543638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.611989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 168/332] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Aug 17 20:00:08 2022] PUT /identity/v3/system/users/69d250ebabd14acea78d561c648eb543/roles/fb37488e6c8844d493ae349bead65655 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:08.813364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:08.817426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:08.917508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c29f-497d-41f7-9414-54ddebc58bf2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:08.953658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:08.954336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:08.954613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:08.954882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:08.956041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:08.957585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc4cfd-49a7-437b-9640-e554a9a7d222 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:08.959497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:08.965049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:09.072539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c774b-55ac-4b05-ab73-4f3ce19dec53 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:09.125008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:09.125620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:09.125973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:09.126208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] PATH_INFO: `/v3/groups` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:09.126834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:09.128332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee83a373-2441-4e12-a707-1b5237ae436b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:09.217134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 169/334] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Aug 17 20:00:08 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:10.608460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d655-6164-47eb-93e8-fab9c6ff9461 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.609634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d655-6164-47eb-93e8-fab9c6ff9461 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.610263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301d655-6164-47eb-93e8-fab9c6ff9461 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.612758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:10.619567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:10.620341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:10.620341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:10.650906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:10.652843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:10.655954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:10.749955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:11.327841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d655-6164-47eb-93e8-fab9c6ff9461 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.418842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.456310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301d655-6164-47eb-93e8-fab9c6ff9461 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.519878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.521478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.522276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.523060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.554529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:11.564904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:11.567443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 20:00:11.569529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:11.573221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 167/337] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:11.579418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.732821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9ba62-f7b3-43ba-bfc6-26a701f83b87 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:11.782599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:11.783140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:11.783445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:11.783720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:11.784411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:11.784715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:11.786231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:11.799216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:11.803526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 171/338] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:11.809664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:11.974803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb6d8-13ce-405b-a805-d3f03f766404 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.010213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:12.017749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.018439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.018720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.018997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] PATH_INFO: `/v3/users/69d250ebabd14acea78d561c648eb543` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.022724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] RBAC: Authorizing `identity:get_user(user_id=69d250ebabd14acea78d561c648eb543)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.024402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381ec04-1301-4c42-a511-c0365b475d27 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.026174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 168/339] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:00:11 2022] GET /identity/v3/users/69d250ebabd14acea78d561c648eb543 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:12.032799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:12.166142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc052d4-bc20-46ee-a4c6-2f9f00fdb958 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:12.212851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:12.213509 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.213791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.214096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.214895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] RBAC: Adding query filter params (role.id=fb37488e6c8844d493ae349bead65655, user.id=69d250ebabd14acea78d561c648eb543, scope.system=all) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:12.215207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:12.216796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381c328-3de3-4c71-8664-e775a22ce14e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:12.237615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 172/340] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 17 20:00:12 2022] GET /identity/v3/role_assignments?user.id=69d250ebabd14acea78d561c648eb543&scope.system=all&role.id=fb37488e6c8844d493ae349bead65655 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:12.256568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e07cce-9cad-4d96-86fc-3249b8cddbae None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.256568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e07cce-9cad-4d96-86fc-3249b8cddbae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.256937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e07cce-9cad-4d96-86fc-3249b8cddbae None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.259316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 169/341] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:12.272309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6eb0a-09fc-4f98-b286-7ff5445772a4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.272592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6eb0a-09fc-4f98-b286-7ff5445772a4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.272870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6eb0a-09fc-4f98-b286-7ff5445772a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.303233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c4a6eb0a-09fc-4f98-b286-7ff5445772a4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:12.304520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c4a6eb0a-09fc-4f98-b286-7ff5445772a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:12.390888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:12.407378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 173/342] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:12.765447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8e0a-f38b-4937-9504-0c86e0f35a95 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.765447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8e0a-f38b-4937-9504-0c86e0f35a95 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.765447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8e0a-f38b-4937-9504-0c86e0f35a95 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.765447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 170/343] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:12.771467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2751-0194-4244-a1e1-2b35498f3331 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:12.772229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2751-0194-4244-a1e1-2b35498f3331 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:12.772229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2751-0194-4244-a1e1-2b35498f3331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:12.796991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0d6e2751-0194-4244-a1e1-2b35498f3331 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:12.798499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0d6e2751-0194-4244-a1e1-2b35498f3331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:12.896275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 174/344] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:13.048892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87597b-fa19-4734-a0a0-b7bd88c8f0ae None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.048892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87597b-fa19-4734-a0a0-b7bd88c8f0ae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.048892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87597b-fa19-4734-a0a0-b7bd88c8f0ae None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.048892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 171/345] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:13.054885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.055264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.055506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.078573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87597b-fa19-4734-a0a0-b7bd88c8f0ae None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.092895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:13.094181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:13.240017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 175/346] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:13.302711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87597b-fa19-4734-a0a0-b7bd88c8f0ae None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.311626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.388196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.389276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.389782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.390295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.432710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:13.452686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:13.454424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:13.456045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 172/347] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:13.466004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.482408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.597780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbb305-ef47-4c94-be83-1eb04bf80847 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.622228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.668369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.669912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.670435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.671135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.688483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:13.693234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b088c-41f0-4a90-b29a-f6a8140a6cfb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:13.694354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:13.696052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 176/348] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:13.697760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.771719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.772342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.772620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.772909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.773567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:13.773866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:13.775339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:13.799297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 173/349] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:13.802394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:13.869704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1831d7-c1e7-4a22-b235-2bd955a33f69 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:13.882780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:13.921322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:13.922833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:13.922833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:13.923012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:13.943054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:13.949121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:13.950157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:13.951003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 177/350] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:13.951680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.006543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e309-8081-4d59-b1a2-82274952573b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.041250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.067220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.068289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.068745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.069225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.070487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:14.071015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.073537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd926-4fcf-4146-aac4-05e697206d8c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.090354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 174/351] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:14.092801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b3f2-f0d7-4b24-912f-a90818e8b3d1 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.093617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b3f2-f0d7-4b24-912f-a90818e8b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.094358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b3f2-f0d7-4b24-912f-a90818e8b3d1 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.098082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 175/352] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:14.100134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10b3f2-f0d7-4b24-912f-a90818e8b3d1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.112444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a26c7-e0b4-41b6-8c7d-345d960375a1 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.185028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.185813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.186216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.186586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.253188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.293372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10b3f2-f0d7-4b24-912f-a90818e8b3d1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.315522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.317904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf15d-b845-4abe-bc32-56b102afba71 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.359871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.360884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.361374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.361853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.362794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:14.363109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.364676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.377337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 176/353] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:14.378347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.471086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.476299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 178/354] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:14.478036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.478441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.478825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.506882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:14.508261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:14.587474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.593025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 179/355] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:14.593629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb135-e35a-4f37-9d9b-92739cf112ee None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.594253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:14.650650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.651682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.652172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.652647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.786425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.789486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.792106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e6632-dc54-46ad-8f5e-782145a16a41 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:14.849027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:14.850618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:14.851420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:14.852180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:14.874379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.964094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:14.968441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:14.971043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656399f-9368-4cd0-8b40-b127bc432ebb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:14.982362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 177/356] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:14.983598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.136497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 180/357] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:15.138643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d808fd-ec58-4747-9ea8-ecc1d00b36ca None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.139134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d808fd-ec58-4747-9ea8-ecc1d00b36ca None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.139607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d808fd-ec58-4747-9ea8-ecc1d00b36ca None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.148520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 181/358] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:15.149788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d808fd-ec58-4747-9ea8-ecc1d00b36ca None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.163863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6eb07-61ba-47ae-8bbb-9f44dd9e8ead None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.228209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.229201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.229608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.230092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.231849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.233959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.236631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 178/359] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:14 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.237832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.261135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.309390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.319508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d808fd-ec58-4747-9ea8-ecc1d00b36ca None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.390976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.391528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.391813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.392096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.395558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bdb52-33e1-4c58-9a0d-c58830b49b16 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.411289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:15.416782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:15.418625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:15.420309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 182/360] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:15.422420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.457222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.458885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.459579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.460248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.462229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.464682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b168ae2-febe-4fe3-88d9-cbd2301669a1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.467902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 179/361] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.471193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.471621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.471816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.494518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:15.496315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:15.581312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d88e9a-1728-4f7b-beaa-f67d575c06b7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.603384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 180/362] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:15.610927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.629002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.668526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.668526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.668526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.668526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.668916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.668916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.673218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 183/363] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.675663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.738927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:15.785835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed43fe-c4e2-4bbf-939e-5b8f2cdb3881 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.840178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.841084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.841503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.842013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.854402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.857012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.861499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 181/364] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.862654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.891304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623989-5215-4ec5-8ca5-fde1087326b6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:15.952810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:15.953669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:15.954529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:15.954669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:15.955948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:15.956379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:15.959262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:15.973443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 184/365] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:15.976398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:15.992088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.028909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3efe9f-9f53-4d35-aab4-0c1a8c0c47ff None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.071517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.072169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.072452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.072724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.074334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.075859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.077655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 182/366] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.079004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.118704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.138169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf09a1d-dd38-4375-9d71-88d1e1403c63 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.186305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.187169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.187456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.187735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.190302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.192956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.196130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 185/367] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:15 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.197335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.225679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e55a0a-0538-4bee-879d-e251e45a4e62 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.279397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.280259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.280594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.280921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.281779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=c5e82a31982b40a5bafc35cb91478a00) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.282199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.284145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.292053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 183/368] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=f25e512661f54369b009eabe1c62d99a => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.292642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.316660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.366165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1172960-82c3-447a-9b12-3416d509cf10 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.428792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.430035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.430493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.430954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.448368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:16.454813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:16.456104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 186/369] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:16.458471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.477150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf062e4-d051-439a-a8bb-6f623567cd31 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.491099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.517551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.518209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.518491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.518760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.609088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.611555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.631139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.658621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13715-4704-4755-b56d-4fbf0519c44c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.715054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.715847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.716256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.716728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.717694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=c5e82a31982b40a5bafc35cb91478a00) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.718619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.720417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:16.738394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 187/370] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:16.738394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.804548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 184/371] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:16.805677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:16.890805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.930830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314e74-24dd-4c15-b645-c648c399123e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.970301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8823d81-f6e7-487d-9d7e-d401750f1491 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:16.984496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:16.989255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:16.990190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:16.990483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:16.990862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:16.992218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=bb674ad817d64501aa0c850044dd08c3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:16.995127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:16.995817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.007370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 188/372] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=f25e512661f54369b009eabe1c62d99a => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.014893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.037863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.038986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.039612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.040239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.041383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:17.041954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.044010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.072524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 185/373] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.080115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.196609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc22966-cc42-4f38-bca6-8fe7dcd65146 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.258656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.259708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.262538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.262817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.264957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.266296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.268232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 189/374] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.273744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.294208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bd13e-5171-4c0e-9728-4c01a77d5ceb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.326400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.334594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.335299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.335589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.335866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.405981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.444170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852aa4e-3480-41fd-b63b-98f9d1ad3923 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.462495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.465201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.542772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.543816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.544346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.544826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.546429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.548155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.551146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 190/375] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.557383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.676065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 186/376] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:00:17.683017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:17.798397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.820400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:17.880942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567f231-5289-4f19-b97a-bd01c1c1dc14 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.904876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431972e2-caab-4d37-bffe-267360f19510 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:17.956158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:17.958141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:17.958639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:17.959129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] PATH_INFO: `/v3/projects/4cdb00bd40c94bdca97e51936bedf565` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:17.961730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] RBAC: Authorizing `identity:get_project(project_id=4cdb00bd40c94bdca97e51936bedf565)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:17.965193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:17.969266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 187/377] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/projects/4cdb00bd40c94bdca97e51936bedf565 => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:17.975792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:18.000294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:18.001357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.001861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.002370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.003766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=bb674ad817d64501aa0c850044dd08c3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:18.004316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:18.017566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:18.036095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 191/378] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 260 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:18.143811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e8c54-589e-4cc9-a513-634e8d9e7f91 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:18.188443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:18.189113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.189392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.189662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] PATH_INFO: `/v3/groups/ba477a9aaddf489db62bafe416cea2eb` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.195835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] RBAC: Authorizing `identity:get_group(group_id=ba477a9aaddf489db62bafe416cea2eb)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:18.197389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e514120-526e-4d1b-9976-d2cde52616e8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:18.199174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 188/379] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:17 2022] GET /identity/v3/groups/ba477a9aaddf489db62bafe416cea2eb => generated 229 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:18.205313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:18.346600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd4248-78cd-4fe6-ade1-d4e7c4ea6211 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:18.389801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:18.390451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.390732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.391006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.391745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] RBAC: Adding query filter params (group.id=ba477a9aaddf489db62bafe416cea2eb, role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=4cdb00bd40c94bdca97e51936bedf565) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:18.392050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:18.393512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666c12-ee18-46b7-aaa7-2eb4c708f3fe None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:18.400541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 192/380] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:18 2022] GET /identity/v3/role_assignments?group.id=ba477a9aaddf489db62bafe416cea2eb&scope.project.id=4cdb00bd40c94bdca97e51936bedf565&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:18.798394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c54-0a90-48ff-a0e1-691c58312eb0 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.799409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c54-0a90-48ff-a0e1-691c58312eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.799409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a4c54-0a90-48ff-a0e1-691c58312eb0 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.800492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 189/381] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:18.806492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10afb-258e-4314-9b65-5327907c8280 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:18.806870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10afb-258e-4314-9b65-5327907c8280 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:18.807130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb10afb-258e-4314-9b65-5327907c8280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:18.830989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dfb10afb-258e-4314-9b65-5327907c8280 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:18.832834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dfb10afb-258e-4314-9b65-5327907c8280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:18.835227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:18.983375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 193/382] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:19.429763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a4c54-0a90-48ff-a0e1-691c58312eb0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:19.434556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:19.453543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d33ff-2387-4dfa-bf8b-0b0d9f386f46 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:19.454357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d33ff-2387-4dfa-bf8b-0b0d9f386f46 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:19.454357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d33ff-2387-4dfa-bf8b-0b0d9f386f46 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:19.457050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 194/383] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:19.464211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:19.464579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:19.464757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:19.525224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:19.527349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:19.692565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a4c54-0a90-48ff-a0e1-691c58312eb0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:19.696492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 195/384] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:19.759196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:19.760729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:19.761490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:19.762263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:19.783402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-c3d77779-9084-48ac-a245-b9e0ced86fa2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:19.794392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:19.796091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:19.797541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:19.802696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 190/385] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:19.811047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:19.923178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:19.962010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded671a4-c2c4-496b-8878-3d8e47fa91e9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.000708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fefcd-2633-4821-b098-8bd17af65ea2 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.001632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fefcd-2633-4821-b098-8bd17af65ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.005723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fefcd-2633-4821-b098-8bd17af65ea2 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.006248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 191/386] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:20.011189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.011836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.012174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.012326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.012460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.012724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.013121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:20.013271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.013399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:20.014849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:20.037359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 196/387] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:20.042851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.052673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:20.055193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:20.195528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:20.212313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 192/388] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:20.214526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.355189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded7f6b-cf12-43b1-9246-7d9eb4d30eff None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.468090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:20.495585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.496249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.496522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.496798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.497992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:20.499463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:20.501287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 197/389] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:20.510913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.533538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c4959-0a65-46f9-9cbd-c6e74bfa7c0f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.604220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.605558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.606233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.606704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.629733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:20.640584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:20.641826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:20.643044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 193/390] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:20.644597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.656852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12fc5e-0e87-49fe-80e7-ca8c561fcfff None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.694949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.695608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.695892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.696167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.697348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:20.698846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:20.705483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 198/391] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:20.706484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.752238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:20.783510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:20.821559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356dc-01cd-44e3-925f-136089084afe None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.851283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936d79-cf01-46c3-b98b-b33083bccf85 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:20.862040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.863455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.863914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.864334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.865193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:20.865703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:20.867891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:20.880401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 199/392] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:20.881535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:20.927260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:20.928326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:20.928809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:20.929286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:20.950778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:20.961579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:20.962747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:20.963938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:20.970030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 194/393] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:20.972002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.006353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983a3b1-d1d8-479d-ac17-2bb4e7cdda48 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.038049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.047337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.048232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.048663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.049083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/groups/883e8a238de64a929c1b6f2800fa629c/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.052474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, group_id=883e8a238de64a929c1b6f2800fa629c, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.054253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.148285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a91b-7fcd-438c-9a60-fb29da940941 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.158093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 200/394] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:20 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/groups/883e8a238de64a929c1b6f2800fa629c/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:21.159938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.175363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.217618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.219131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.220682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.221153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.224276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.226285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.231427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 195/395] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:20 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:21.235730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.385006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfa2-d441-44b4-aa1c-383f0575c9be None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.417268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5fb18-c0af-4477-9fdb-c92562c87680 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.441335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.442381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.442863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.443350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.444537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:21.445075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.447619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc874771-967c-42a7-b168-778c5a7357a0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.450269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.450908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.451213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.451493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.452616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.454092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fd45f-255b-488b-b4f1-952f0b839f54 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 196/396] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34753be-4abd-44b5-add0-a9e7734e4e86 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34753be-4abd-44b5-add0-a9e7734e4e86 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34753be-4abd-44b5-add0-a9e7734e4e86 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 197/397] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:21.461035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb120-b9b7-4a1e-a2b4-062680881be0 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.461510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb120-b9b7-4a1e-a2b4-062680881be0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.461510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb120-b9b7-4a1e-a2b4-062680881be0 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.462474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 198/398] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:21.462911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb120-b9b7-4a1e-a2b4-062680881be0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.473132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 201/399] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:21.475333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8bd6-7518-4c2a-9c61-f825a0950061 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.475849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8bd6-7518-4c2a-9c61-f825a0950061 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.476319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8bd6-7518-4c2a-9c61-f825a0950061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.507920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2d2c8bd6-7518-4c2a-9c61-f825a0950061 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:21.510013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2d2c8bd6-7518-4c2a-9c61-f825a0950061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:21.519697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.576964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.585741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb120-b9b7-4a1e-a2b4-062680881be0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.601601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 202/400] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:21.602847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.603132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.603405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.622723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:21.624076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:21.646810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.647494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.648090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.648090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00/groups/883e8a238de64a929c1b6f2800fa629c/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.650438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e82a31982b40a5bafc35cb91478a00, group_id=883e8a238de64a929c1b6f2800fa629c, role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.652069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.705653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 203/401] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:21.707315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:21.743059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 199/402] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:21 2022] PUT /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00/groups/883e8a238de64a929c1b6f2800fa629c/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:21.869197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b0fc4-2aa1-440e-9076-ef3c9cbd5259 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:21.883500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:21.919560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:21.920469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:21.920922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:21.921352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:21.922714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:21.924340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:21.926790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 204/403] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:21.932893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.052009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb0b55-48c0-4d7b-8f82-6fc58363b555 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.057230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.062863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.113355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.114671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.115386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.116573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.119023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.122460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.125644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 200/404] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:21 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:22.133512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.274456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e59100-49ea-43e8-92b9-21f88563b4c4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.318562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.320627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.320908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.321177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/groups/883e8a238de64a929c1b6f2800fa629c/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.325927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, group_id=883e8a238de64a929c1b6f2800fa629c, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.327434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.338847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb8976-d79a-4772-bf03-7e8e9572ca94 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.383425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.384179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.384635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.384992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.399563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:22.404844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:22.405852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:22.406680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:22.407358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 205/405] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:22.408532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.457215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 201/406] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:22 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/groups/883e8a238de64a929c1b6f2800fa629c/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:22.459154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.506173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.515609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.606998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c1fa-272e-4ea7-8cfd-0f74f8ebd796 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.657467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.659397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.659956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.660449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.660959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78581d-f005-4a4d-ba75-b5b51ac6beff None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.661644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:22.662194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.665602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.679395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 202/407] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:22.687014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.711448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.711843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.712199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.712539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.732770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:22.742965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:22.743936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:22.744837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:22.745720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 206/408] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:22.756330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:22.826664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5ae35-2086-42eb-908f-ef8a0f30750f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:22.830283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:22.912352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:22.913014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:22.913292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:22.913564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] PATH_INFO: `/v3/groups/ba477a9aaddf489db62bafe416cea2eb` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:22.916385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] RBAC: Authorizing `identity:get_group(group_id=ba477a9aaddf489db62bafe416cea2eb)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:22.917869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:22.928138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 203/409] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/groups/ba477a9aaddf489db62bafe416cea2eb => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:22.943226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.028582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.038056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb105-83c3-48a8-8378-de3cef596bf3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.084322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dc448-1320-4c22-9668-9cbafa7f4f57 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.125476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.125873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.126182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.126464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.126565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.126734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] PATH_INFO: `/v3/projects/4cdb00bd40c94bdca97e51936bedf565` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.126827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.127056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.127901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:23.128009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=4cdb00bd40c94bdca97e51936bedf565)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.128204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.129611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.129727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.131651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 204/410] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/projects/4cdb00bd40c94bdca97e51936bedf565 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:23.139453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.161019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 207/411] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:23.171037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.181215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.263566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d875-ac92-4f5d-888f-d8902b6cb8b6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.306322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.307742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.308211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.308631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] PATH_INFO: `/v3/projects/4cdb00bd40c94bdca97e51936bedf565/groups/ba477a9aaddf489db62bafe416cea2eb/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.311281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cdb00bd40c94bdca97e51936bedf565, group_id=ba477a9aaddf489db62bafe416cea2eb, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.313102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.378589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a7a46-3daa-4f12-9402-1d33a194a9b7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.390310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 205/412] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:23 2022] PUT /identity/v3/projects/4cdb00bd40c94bdca97e51936bedf565/groups/ba477a9aaddf489db62bafe416cea2eb/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:23.428452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.429479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.429956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.430384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.431829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.433454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.435790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 208/413] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:23 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:23.444948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.591528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea091079-36f0-448d-aed5-7a731e2a8144 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.594244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.664448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.665483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.665960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.666420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.669738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.673509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d70b5-4f77-4e4e-a926-558f2c2e5099 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:23.677762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 206/414] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:23 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:23.686551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:23.745819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:23.787140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b97b6-d492-414b-9bbb-47b8da11813b None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.787603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b97b6-d492-414b-9bbb-47b8da11813b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.788089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b97b6-d492-414b-9bbb-47b8da11813b None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.790724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 207/415] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:23.800916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c993-1cfa-422a-bd64-0d47564e8de8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.801370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c993-1cfa-422a-bd64-0d47564e8de8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.801868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067c993-1cfa-422a-bd64-0d47564e8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.835746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a84b1-e6c0-483f-b57f-382567e7bde5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:23.867917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7067c993-1cfa-422a-bd64-0d47564e8de8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:23.870428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7067c993-1cfa-422a-bd64-0d47564e8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:23.880120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:23.880818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:23.881106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:23.881388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3/groups/883e8a238de64a929c1b6f2800fa629c/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:23.883998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb674ad817d64501aa0c850044dd08c3, group_id=883e8a238de64a929c1b6f2800fa629c, role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:23.885687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:24.005578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 209/416] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 17 20:00:23 2022] PUT /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3/groups/883e8a238de64a929c1b6f2800fa629c/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:24.011913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 208/417] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:24.594194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:24.770148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:24.792980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a06d4-8764-43cc-abe9-f5a7fa88adf5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:24.836088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484594f4-4f7f-4d0f-b8de-e62b501386a0 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.836599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484594f4-4f7f-4d0f-b8de-e62b501386a0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.837478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484594f4-4f7f-4d0f-b8de-e62b501386a0 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.844475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 209/418] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:24.850777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.851056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.851417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.879917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:24.880583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:24.880869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:24.881146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:24.884187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:24.885420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:24.907773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:24.914096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:24.915041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:24.915849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:24.921987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:24.924203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:25.040286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 210/420] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:25.177571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d3631-e62f-4d6a-96b3-37801b6903ab None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:25.256736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:25.257792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.258324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.258767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.259881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:25.260421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:25.262814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:25.287070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:25.295480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:25.359170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:25.520353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cbca0-94aa-4ecc-a166-ba0b96ecdcaa None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:25.595051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98320-989e-4677-b178-03af39f40564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:25.597047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98320-989e-4677-b178-03af39f40564 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.597736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98320-989e-4677-b178-03af39f40564 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.598307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98320-989e-4677-b178-03af39f40564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.614690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:25.646250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:25.771744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c98320-989e-4677-b178-03af39f40564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:25.774815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c98320-989e-4677-b178-03af39f40564 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:25.841818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:25.850677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff77bec-bf1f-40d4-837d-accd4e557f23 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:25.895764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:25.897056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.897608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.898161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.925403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7ce5cf31-6970-40b4-9930-7e6450dd7732 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:25.942427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:25.943701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:25.944758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:25.947740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 212/422] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:25.950920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210193e-0f38-4959-be87-b2adc43c639b None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.952233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210193e-0f38-4959-be87-b2adc43c639b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.952817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210193e-0f38-4959-be87-b2adc43c639b None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:25.957744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 213/423] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:25.962081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210193e-0f38-4959-be87-b2adc43c639b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:25.996299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 211/424] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:25.996299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:25.996299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:25.996299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.035502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:26.037373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:26.084051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.146360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 212/425] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:26.148175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.168237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210193e-0f38-4959-be87-b2adc43c639b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.274777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.279885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.280941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.281401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.281931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.283092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:26.284117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.294722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.321948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 214/426] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:26.331700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.368260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528b808-7083-4e46-86c9-73a546dea614 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.439137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.440903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.441387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.441858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.450524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.453267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.460321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 213/427] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:26.468866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.595133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0719fd-9013-4530-98a8-6f4052dc7c15 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.651686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.660223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.661198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.661663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.664204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.689080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512ca66-796c-4214-aa02-9bb1e2fb0b2d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.733449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:26.760525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:26.761621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.762223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.762670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.765546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.769113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d49168-8f1e-443f-a7ef-50159851fb54 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.772380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 214/428] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:26.774791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8000-fd9b-4049-9ccb-40c0a6b8bcf8 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:26.775315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8000-fd9b-4049-9ccb-40c0a6b8bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:26.775775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a8000-fd9b-4049-9ccb-40c0a6b8bcf8 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:26.781195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 215/429] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:26.782668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a8000-fd9b-4049-9ccb-40c0a6b8bcf8 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.782941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:26.784517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:26.947936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 215/430] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:00:26.949155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:26.971808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a8000-fd9b-4049-9ccb-40c0a6b8bcf8 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:26.995930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.035269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.036316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.036887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.037360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.058107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-47f547b1-9355-4b3b-a6be-a34be296352e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:27.068053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:27.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 20:00:27.069841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:27.070494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 216/431] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:27.073424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.073948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.076319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.104265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:27.106414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:27.117713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac340f3-1991-445c-afe9-b1fa6ea16dfb None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.177119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.178122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.178581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.179062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.180316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=c5e82a31982b40a5bafc35cb91478a00) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:27.180822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.183133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.187164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.193258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 216/432] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:26 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=f25e512661f54369b009eabe1c62d99a => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.194665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.228474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 217/433] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:27.232291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.414565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.425487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f95f-6f6c-40fb-9aa5-b7858a0f28c1 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.474754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfbbd-74d2-4ac8-88e8-c9aebda5b5fa None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.484627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.485199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.485484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.485751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] PATH_INFO: `/v3/projects/c5e82a31982b40a5bafc35cb91478a00` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.488342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c5e82a31982b40a5bafc35cb91478a00)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.489906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d383cb-4eac-491e-96be-bd6faa5a90a1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.496383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 217/434] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/projects/c5e82a31982b40a5bafc35cb91478a00 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.499799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e6318-9cfa-4a97-b246-c15cb179270e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.500305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e6318-9cfa-4a97-b246-c15cb179270e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.500796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e6318-9cfa-4a97-b246-c15cb179270e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.505437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 218/435] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:27.506675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e6318-9cfa-4a97-b246-c15cb179270e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.538221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.539894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.540624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.541269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.542213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] RBAC: Adding query filter params (name=member) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:27.542725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.544745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db38e7-cbc1-4246-892d-23a044f1efdb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.555931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 218/436] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.557690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.558296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.558786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.579030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:27.580658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:27.620725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.666928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 219/437] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:27.667945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.710782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e6318-9cfa-4a97-b246-c15cb179270e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.786759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.787312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.787586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.787868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.789823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.794720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.794720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 219/438] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:27.794720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:27.801969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053651f-d0a2-4e79-ad41-b424f12922e7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.840621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.871518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.872314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.872592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.872867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.929394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:27.941237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac3097-9b66-4969-baf3-ae3f2c711205 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:27.966958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:27.968446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:27.986397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:27.987220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:27.987620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:27.987942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:27.999829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:28.005834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.010472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 220/439] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.012095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.082413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 220/440] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:28.083201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.138979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.151575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91786a39-65de-4dba-bfdc-0a6539ca9fc5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.165376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.199034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.199639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.199914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.200184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.200907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=c5e82a31982b40a5bafc35cb91478a00) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.201216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.201342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5be570-5c37-41a1-bb02-0f56c7fcfa5e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.202708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.210553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 221/441] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=c5e82a31982b40a5bafc35cb91478a00&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.210831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.259833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.259833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.259833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.259833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.274057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:28.280086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:28.281062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:28.281865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:28.284165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 221/442] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:28.286084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.373009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4beb7-ec40-40b5-9a09-2d30b53490a7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.415786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.416407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.416683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.416950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.417620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.417954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.419353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.420101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f364a-4fcc-4b9e-9cdd-40a70c324f2b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.429964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 222/443] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.430921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.454749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.472217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.478615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.479263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.479587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.479865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.481115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.482651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.484354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 222/444] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.485230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.602867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2563ea-6342-45a7-a998-477a5be0dadc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.627543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0279d2c-8c7d-46c8-9bce-b98233a2530a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.676383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.677021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.677136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.677300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.677570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.677916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.678190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.678290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:28.678462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.678577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.679955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.695864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 223/445] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.696885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.763255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.769133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.771792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.799571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:28.833009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa938ff-4236-4179-8943-bc48f9df689a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:28.887513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:28.887513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:28.894167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:28.894824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:28.895101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:28.895374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:28.896535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:28.898033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:28.899664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 224/447] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:28.900443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.013442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.019719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dc5d1-6380-44cf-8807-741a978927fe None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.044377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f6c6d-bbb7-4f15-8f6f-4c218624e118 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.068909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.069906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.070362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.070804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.096750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.097793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.098134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.098407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] PATH_INFO: `/v3/projects/4cdb00bd40c94bdca97e51936bedf565` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.099695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] RBAC: Authorizing `identity:get_project(project_id=4cdb00bd40c94bdca97e51936bedf565)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.101604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.103326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 225/448] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/projects/4cdb00bd40c94bdca97e51936bedf565 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.104090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.125638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.175997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.177624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.241647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77033ee-b2ef-40f2-b88d-759217289884 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.288320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.288932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.289212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.289481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.290244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=f25e512661f54369b009eabe1c62d99a, scope.project.id=bb674ad817d64501aa0c850044dd08c3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.290557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.292144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.298731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 226/449] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=f25e512661f54369b009eabe1c62d99a => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.299776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.313435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.320509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 224/450] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:29.326548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.433533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.468055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa035-4931-44d5-908c-7c066b03c9c6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.501038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8580c-a8b0-431e-b2a2-e2d369c06a14 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.531477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.532884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.533407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.533944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] PATH_INFO: `/v3/groups/ba477a9aaddf489db62bafe416cea2eb` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.536071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] RBAC: Authorizing `identity:get_group(group_id=ba477a9aaddf489db62bafe416cea2eb)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.538713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.542023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 227/451] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/groups/ba477a9aaddf489db62bafe416cea2eb => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.549129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.556980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.558197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.558664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.559121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] PATH_INFO: `/v3/projects/bb674ad817d64501aa0c850044dd08c3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.561301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] RBAC: Authorizing `identity:get_project(project_id=bb674ad817d64501aa0c850044dd08c3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.564014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.567570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/projects/bb674ad817d64501aa0c850044dd08c3 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:29.576410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.685344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.719134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e803bf7-e477-4649-8d3b-fd00af7137dd None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.739216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a2d1b-88f6-4bc2-bb46-9ad32b199c25 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.767095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.768061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.768518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.768966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.770279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] RBAC: Adding query filter params (group.id=ba477a9aaddf489db62bafe416cea2eb, role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=4cdb00bd40c94bdca97e51936bedf565) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:29.770663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.773192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.783852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/role_assignments?group.id=ba477a9aaddf489db62bafe416cea2eb&scope.project.id=4cdb00bd40c94bdca97e51936bedf565&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:29.796829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:29.797505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:29.797788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:29.798110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] PATH_INFO: `/v3/groups/883e8a238de64a929c1b6f2800fa629c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:29.800161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] RBAC: Authorizing `identity:get_group(group_id=883e8a238de64a929c1b6f2800fa629c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:29.802086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793965d3-a66c-4ad4-98e0-9015a675d725 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:29.803890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/groups/883e8a238de64a929c1b6f2800fa629c => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:29.810452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:29.830393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:29.951819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864f855-a289-4292-a628-146b9ea68fe7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:29.999537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:30.000184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:30.000471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:30.000730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:30.001505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] RBAC: Adding query filter params (group.id=883e8a238de64a929c1b6f2800fa629c, role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=bb674ad817d64501aa0c850044dd08c3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:30.001895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:30.003705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40323928-9762-4ca9-a6f3-f6ff909c51a4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:30.011174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 17 20:00:29 2022] GET /identity/v3/role_assignments?group.id=883e8a238de64a929c1b6f2800fa629c&scope.project.id=bb674ad817d64501aa0c850044dd08c3&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:32.904065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f58ed-55a7-42d2-87c7-80583a58c072 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.905681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f58ed-55a7-42d2-87c7-80583a58c072 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.906470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f58ed-55a7-42d2-87c7-80583a58c072 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.910364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:32.919201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa177-cfed-4664-ab53-1ed80507cfe7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:32.920911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa177-cfed-4664-ab53-1ed80507cfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:32.921688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aa177-cfed-4664-ab53-1ed80507cfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:32.951446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-053aa177-cfed-4664-ab53-1ed80507cfe7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:32.952680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-053aa177-cfed-4664-ab53-1ed80507cfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:33.077701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:33.251930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffb56-8e15-44dd-8b69-b39ff85c7b2b None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.252976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffb56-8e15-44dd-8b69-b39ff85c7b2b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.254105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffb56-8e15-44dd-8b69-b39ff85c7b2b None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.257464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 228/458] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:33.262942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.263232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.263510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.280330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.292270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:33.293575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:33.386171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fecae-4b9d-4af7-9c11-4e0499cfe05b None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.386477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fecae-4b9d-4af7-9c11-4e0499cfe05b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.386812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fecae-4b9d-4af7-9c11-4e0499cfe05b None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.388225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 229/459] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:33.403889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.405376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 231/460] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:33.405547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.405547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.425456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:33.426709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:33.556262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 230/461] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:33.580300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.739575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.771477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c1791-8264-4eb5-b5b8-8909ad7ef148 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.809624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.810710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.811401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.811913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:33.825057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:33.826358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.831706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:33.863689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:33.864733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:33.865635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:33.865635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:33.865635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:33.874864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 232/462] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:33.883798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:33.905821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:33.950830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013e689-0a18-4653-8acb-d19fe3654f81 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:33.990126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:33.991033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:33.991493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:33.991983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.005476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.007342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-ae3a8d46-f63e-4fd6-bc14-63765bbce5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:34.024726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:34.025751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:34.026642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:34.026642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.026642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:34.028883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 231/463] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:34.035064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dff39-a987-4a41-be53-c39b24b791c7 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.035700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dff39-a987-4a41-be53-c39b24b791c7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.036201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dff39-a987-4a41-be53-c39b24b791c7 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.038128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 232/464] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:34.039893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dff39-a987-4a41-be53-c39b24b791c7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.086084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c0da2-21b0-470e-8e09-61f330018d3b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.152753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.153846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.154302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.154755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.155638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.156072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.158761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d5ee0-ad27-4e4c-8e56-e7b6c8deb345 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.162415 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dff39-a987-4a41-be53-c39b24b791c7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.180626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 233/465] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:34.182190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.182489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.182813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.187123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.203785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:34.205769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:34.210887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.211528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.211813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.212089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.212768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.213077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.214609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.232055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 233/466] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:34.232944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.292614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.329932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 234/467] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:34.329932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.412161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a694c-e5c7-4b12-90b5-5ef4e255ea12 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.457935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.458718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.459024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.459294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.474003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.475474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:34.496762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:34.498711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:34.500401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:34.500401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:34.500401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:34.500401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 234/468] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:34.500401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.515633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbc5c9-f638-434e-83d7-10e81d636060 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.553317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.562844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.563486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.563793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.564070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.564714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.566299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.686637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 235/469] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:34 2022] POST /identity/v3/users => generated 248 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:34.689437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65f6f-82b1-475d-a8b2-c4f5b8d1c15e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.699291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.738009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.738648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.738927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.739203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.739887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.741485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f95e8-1fae-46cd-9b7c-5c724230fa33 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.751884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:34.835297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50f092-9860-4d01-8b34-9175b0779806 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:34.849109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 235/470] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:34 2022] POST /identity/v3/users => generated 248 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:34.851490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684e33-b8eb-4137-ba05-5c302aa5b0c1 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.852062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684e33-b8eb-4137-ba05-5c302aa5b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.852552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684e33-b8eb-4137-ba05-5c302aa5b0c1 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.854947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 236/471] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:34.856242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86684e33-b8eb-4137-ba05-5c302aa5b0c1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:34.883373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:34.884346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.884622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.884895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.885568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:34.885866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:34.887350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04fd3-6c7f-4a5c-a62c-c9a760aba7f6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:34.908232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 236/472] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:34.910974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:34.911479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:34.911969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:34.946356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:34.947691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:35.031484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.057986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 237/473] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:35.060026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.088498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86684e33-b8eb-4137-ba05-5c302aa5b0c1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.125260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.161638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.163112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.163388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.163655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.179565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.181088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:35.198593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:35.200258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:35.201944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:35.201944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:35.201944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.201944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 237/474] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:35.209466 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.299427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8e031-4527-4737-9cce-4c15218100a5 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.363889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.365376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.366187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.366942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.368396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.371662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.427132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f42d2-17e3-4eb3-b5aa-4ed6e17920e0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.465468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.466039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.466313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.466582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.467232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:35.467528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.468909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.472935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.483602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 238/475] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:35.484263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.506833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 238/476] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:35 2022] POST /identity/v3/users => generated 246 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:35.508520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:35.631025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:35.657094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b7a4-59d4-4751-9783-3520fcb1589e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.692877 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef043e-d6cf-414e-a3d3-15de09b180d0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:35.713321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.714412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.714921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.715407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.716783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.719001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.785786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:35.786915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:35.787407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:35.787881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:35.789218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:35.791976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:35.843778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 239/477] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:35 2022] POST /identity/v3/users => generated 249 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:35.869470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.sql.core [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:35.869470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 20:00:35.869470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [parameters: {'id': '9473941733254551ad97b3e4a3c13eba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 20:00:35.869470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81921) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:00:35.894223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:00:35.895306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application yield resource Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise self.value Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application session.commit() Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:00:35.896254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:00:35.897164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:00:35.898148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:00:35.899012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [parameters: {'id': '9473941733254551ad97b3e4a3c13eba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:35.899824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 20:00:35.900649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:35.901523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 239/478] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 17 20:00:35 2022] POST /identity/v3/roles => generated 144 bytes in 412 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:35.910376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.137400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ad267-8805-4532-93b0-b2593e4dd3f2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.211463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.212573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.213062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.213518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.220023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.236970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f4930834-3812-47a2-aa44-1019d6b9a671 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:36.247461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:36.250874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:36.254611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 240/479] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:00:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:36.269678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:36.381999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:36.458812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca850f-69c1-4dd1-9fd1-91d323175810 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:36.535999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:36.537037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.537541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.538074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.539579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:36.540141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:36.551124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a7fc99-e71c-48e1-a165-c795b13797e2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:36.573237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 240/480] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:36.977562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143808-75e1-4310-81b3-5570356e9215 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.978008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143808-75e1-4310-81b3-5570356e9215 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.978187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00143808-75e1-4310-81b3-5570356e9215 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:36.979810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 241/481] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:36.985497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:36.985857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:36.986400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.008247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:37.009459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:37.097790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 241/482] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:37.421340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00143808-75e1-4310-81b3-5570356e9215 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.566623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00143808-75e1-4310-81b3-5570356e9215 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.614131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.614792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.615069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.615395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.633940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:37.639446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:37.640410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:37.642345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 242/483] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:37.647501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:37.714760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:37.813941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529bf51-409a-41aa-a3e9-2781b2a263e9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:37.900376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:37.901291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:37.901776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:37.902295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:37.903518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:37.904063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:37.906868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29308cd6-c013-4c74-a76b-e6eada09246c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:37.927036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 242/484] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:37.936228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.058968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.169379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a0205-64f0-4f4c-b5f3-e995dc89ff4a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.236150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.237260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.239255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f1094-ecf3-4c9b-8f48-aed449c89598 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.239589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f1094-ecf3-4c9b-8f48-aed449c89598 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.239939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f1094-ecf3-4c9b-8f48-aed449c89598 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.248232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 243/485] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:38.248591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.248934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.254353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0973-b67f-4b5b-94d6-22282732200b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.254637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0973-b67f-4b5b-94d6-22282732200b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.254887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0973-b67f-4b5b-94d6-22282732200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.281641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.284262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.284908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b1fc0973-b67f-4b5b-94d6-22282732200b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:38.287778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b1fc0973-b67f-4b5b-94d6-22282732200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:38.311255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:38.312230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:38.313094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:38.313094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:38.313094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:38.314029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 243/486] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:38.318580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.451330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 244/487] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:38.453131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062215f-d947-4b88-a185-434faae6a51c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.453455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062215f-d947-4b88-a185-434faae6a51c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.453894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062215f-d947-4b88-a185-434faae6a51c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.455416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 245/488] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:38.462345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.462758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.463256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.488189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:38.489527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:38.521185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbaca9-162d-4959-80a4-92ac45a9d58a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.531840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.561917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.562546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.563130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.564024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.565550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:38.565761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.567258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.582404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 244/489] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:38.594174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.620966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:38.668255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 246/490] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:38.785308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca779568-1fe6-4600-92e3-5b84bfeb5740 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:38.840039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:38.840929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.841353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.841791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.850333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:38.852052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-8018d9e6-bfa4-4e28-a416-e96bcfdc0f4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:38.872077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:38.873434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:38.875126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:38.878257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 245/491] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:38.885908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:38.896455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e8e6-fbd1-4277-9c88-0b32b039bde4 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.896970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e8e6-fbd1-4277-9c88-0b32b039bde4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.897452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644e8e6-fbd1-4277-9c88-0b32b039bde4 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.899361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 246/492] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:38.905124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:38.905636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:38.906139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:38.926239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:38.927808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:38.954586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.017920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 247/493] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:39.017920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.067919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a0ba-e25e-4f00-a2d0-7298c9428112 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.125625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.126838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.127117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.127490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.128391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.128703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.130811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.182065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 247/494] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.183371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.208338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c595c-c78b-4055-b9a9-c669babca8fb None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.240371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.275439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.276745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.277392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.278004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.299036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:39.308748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.309938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:39.310871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 248/495] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.312153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.345501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.357104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53410-ddee-46e3-a5a3-6cdfebce996a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.396625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.397281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.397574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.397817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.410514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:39.415389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.418549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 248/496] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.419564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.458081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd85f8-88dd-481b-b980-84765fcdb0db None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.498251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.498866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.499147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.499416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.558837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.568939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d2d4-a487-4301-ad08-90c19c24c5aa None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.603551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.604984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.619947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.621027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.621532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.622118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.628118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.643409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:39.652985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:39.654124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:39.655030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:39.655724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 249/497] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:39.657509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.741333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 249/498] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:39.742727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.786272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acae5-60a3-44a7-9855-16a563591d6e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.821680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.822312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.822590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.822859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.823530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.823829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.825222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.834256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 250/499] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.835090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.851560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.893621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea91c9-85cf-4ccb-9838-a9a738d46acb None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.912856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:39.931766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.932391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.932659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.932928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.933607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:39.933925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:39.935342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c7002-713c-4e33-bef0-d54951a85df9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:39.944592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 250/500] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:39.945841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bcfe-1660-4902-b19e-db312d8108ce None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.946159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bcfe-1660-4902-b19e-db312d8108ce None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:39.946442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bcfe-1660-4902-b19e-db312d8108ce None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:39.947822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 251/501] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:39.948369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9bcfe-1660-4902-b19e-db312d8108ce None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:39.953503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e7224-0d55-4e42-9488-8dd2ca1d9699 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:39.998952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:39.999564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:39.999875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.000167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.001515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.001783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.003450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.019716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 251/502] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.019716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.085436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9bcfe-1660-4902-b19e-db312d8108ce None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.103745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.124493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.125149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.125619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.126362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.134988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879abab4-3b3d-494f-8a68-c247dc68dd31 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.137593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.139123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.155250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.156871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.159198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.159198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.159198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:40.159198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 252/503] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.159198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.178048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.178938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.179427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.179868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.195529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.197061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.201305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-7901449e-c73e-4f7d-aeca-342fe818a8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.213718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.215757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 252/504] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.217426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.243773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:40.245831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:40.298299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf1ae-c689-48fd-a5cc-5b448b46d81d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.341699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.342372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.342655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.342929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.343014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 253/505] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:40.358112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.358269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.358269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.376269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.378351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.380287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.380287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.380287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:40.382693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 253/506] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.383629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.446175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.504855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.511317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f2f48-392c-4149-b989-7ff6ed188b83 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.525305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7b6e3-d4e6-4200-8fc1-e1a257d76bba None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.562747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.563602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.564074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.564535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.580774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.583509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.584111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.585024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.585482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.585970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.587054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.587636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.589391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.609968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.611957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.612802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.612802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.612802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:40.612963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.613840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.619054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 254/508] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.619751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.733220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfef0c-5d35-4757-8155-d199750dba31 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.768416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebbc3-1fb5-4b96-aaeb-297d59bf9e7d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.770688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.771310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.771616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.771887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.772536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.772836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.774264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.786545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 255/509] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.787395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.788231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.792826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:40.822253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.823038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.823580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.823924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.824734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:40.825106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.826906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.840737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 255/510] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:40.841691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.906327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9ed77-4bb8-4870-8b70-0de156829b1d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:40.947088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:40.947750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:40.948023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:40.948291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:40.961196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:40.962757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:40.978726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:40.979876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:40.980757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:40.980757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:40.980757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:40.980757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:40.980982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:40.987116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913afc6-e27d-4943-a498-633af6cb2f1b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.029432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.030393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.030682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.031109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.039281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.040775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.054123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:41.055113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.056153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:41.057063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 256/512] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.057603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.092867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.104684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840ffa1-3e18-48e9-8db5-a6b7d81ae045 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.142864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.143485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.143761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.144030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.144682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.144974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.146894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.163041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 257/513] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.163996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.175126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9176e-e506-4b01-a192-d174458d31fd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.231401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.232141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.232489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.232826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.241364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.242952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:41.259897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.261299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 257/514] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.262861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.318357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ffdec-ab7a-4e7b-8f72-3d58bebb6060 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.336213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.355930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.356752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.357140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.357546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.366391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.367986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:41.380986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.382160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:41.383126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 258/515] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.383701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.416435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.428039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942d7d6-22b7-49a9-88f3-dfd551223266 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.466731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.467345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.467622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.467896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.468544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.468844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.471011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.484387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 258/516] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.486081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.524335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de6fc-bf2d-44d7-add3-4a490030261d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.563778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.564399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.564679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.564950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.565651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.565977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.567452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.587498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 259/517] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.588353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.603788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8ba15-d0ff-4edb-83c5-b8440c381111 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.627740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.650502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.651390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.651700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.657540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.666038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.667576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:41.680624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:41.682813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 259/518] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:41.684613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.697452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.713861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe846b-d6fe-4c8d-b268-25bc8d59f081 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.759021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.760099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.760609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.761192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.762677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.763215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.766076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.812711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f65b85-938d-442d-ab59-6234aa52f4ab None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:41.836566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 260/519] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.838204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.854224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:41.854852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:41.855134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:41.855410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:41.856153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:41.856460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:41.857949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:41.877393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 260/520] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:41.878295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:41.966487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.978270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:41.985713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b392a-dfb5-4939-8d03-67dce259fcb3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.020306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d685db-2960-44f3-a24f-446a22b63a9f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.026507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.027255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.027535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.027811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.028481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.030064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.083499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.084444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.084944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.085433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.086863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e24a6be002b144dea05cfd340fdb173f) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:42.087423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.090143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.109827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 261/521] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:41 2022] GET /identity/v3/role_assignments?user.id=e24a6be002b144dea05cfd340fdb173f&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:42.109827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.206009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 261/522] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:00:41 2022] POST /identity/v3/users => generated 247 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:00:42.206009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.318411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4341-ab56-4e08-abb4-132ed3d18fdd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.354649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.360885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.361524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.361810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.362121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.362875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:42.363410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.366277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.387011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 262/523] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:42.387932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.432980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5599319-a988-4531-be90-fae42861ce6c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.495051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.496021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.496480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.496899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.528450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f01b01-e06a-4faa-a986-1c600d3a6eb3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.548073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.586567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.586567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.586567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.586567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.638162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.642475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.674725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.689659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:42.692016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:42.790081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 262/524] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:42.791380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.830746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 263/525] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:42.831711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:42.858041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.917048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c18f-90b6-4963-a1f5-5334b4acc507 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.941664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:42.952810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14868150-46c1-4730-b30e-0963881ce797 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:42.957501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.958177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.958459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.958730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:42.993840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:42.994663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:42.994957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:42.995226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.008416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.009927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:43.027929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.028889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:43.030422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:43.030422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.030422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:43.030422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 264/526] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.030422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.042045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.043564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.099761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.156411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9778c5-fe08-4461-8b33-86671d456a20 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.161615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 263/527] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:43.161615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.210968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.211842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.212262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.212670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.226198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.228215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.230561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:43.246305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.247508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:43.248426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:43.248426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.248426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:43.250297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 265/528] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.252543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.289742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b788fc1-b5f1-4e5d-805e-abdd4a21944e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.347648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.348637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.349407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.350895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.351788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:43.352294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.353920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.372636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 264/529] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:43.373573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.387440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.394467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bac212-6efc-437a-9ef5-f9455724afa9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.440125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.440693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.440973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.441247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.454783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.456276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:43.473855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.474818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:43.475663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:43.475663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:43.475663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:43.479660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 266/530] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.480709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.506916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291fcd-de09-4120-a7ba-ea61505da877 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.537227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.558587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.559771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.560272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.561327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.562381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:43.563074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.565853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.582781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 265/531] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:43.584151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.611743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0cb2f-744d-42f6-8271-2e0eba9a4fc6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.656364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.657506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.658057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.658529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.668172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.670075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:43.683170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.684102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:43.684953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:43.687529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 267/532] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.689229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.693766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.744279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfadad-dd19-4030-918e-4b3da23ef010 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.787259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.787917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.788197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.788467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.789129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:43.789529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.791542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.809084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 266/533] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:43.809084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.839823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8bae-bd9b-4e26-8fe4-cc300bf07047 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.849308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:43.883132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:43.884093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:43.884280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:43.884497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:43.893020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:43.894595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:43.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:43.909219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:43.910192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:43.914332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 268/534] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:43.915745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:43.955429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e1dd-0cfb-4b72-82a4-d22b0bb77f04 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:43.999545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.007895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.010881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.010881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.010881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.011115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.011454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.012991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.031800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 267/535] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.033461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.055293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece73dd-1f72-4018-aa7b-38bf74feb95d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.106241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.107260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.107542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.107813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.119340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.121599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:44.137980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:44.138900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:44.139759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 269/536] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:44.141751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.173897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302e1b-777d-4c52-b6eb-671fa6405ec0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.174102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.216836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.217506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.217797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.218097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.218860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.222234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.222234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.236422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 268/537] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.237508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.274345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f6953-6b03-461e-b533-8180066249e8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.301673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.316507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.317372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.319996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.319996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.319996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=af188d89b2fe416884b5f80ff25b8d45) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.319996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.321192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.328025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 270/538] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/role_assignments?user.id=af188d89b2fe416884b5f80ff25b8d45&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.329287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.369426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8647-9f3b-48ca-893e-f33b5b1fd8c5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.445536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.458854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.459494 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.459772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.460043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.460567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd71d5-f993-4636-9fc4-7cf22982a5e1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.460769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.461079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.462633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.491663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 269/539] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.506201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:44.527789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.530838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.531320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.533411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.537246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.537933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.541245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de4a6-65c9-4a4e-9a02-3ca57fce0de5 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.563990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 271/540] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.701786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d181126-9679-43ed-b209-aa04fb6f9dbc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:44.724809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:44.761932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:44.762550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.762831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.763101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.764324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=880635427a704e0e8107da0a07088237) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:44.764651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:44.766908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199708e-9379-4eb7-b3fd-61138107aba1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:44.774448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 270/541] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:44 2022] GET /identity/v3/role_assignments?user.id=880635427a704e0e8107da0a07088237&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:44.833169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8961e5-a395-47cc-abda-c11d3f724b2f None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.833528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8961e5-a395-47cc-abda-c11d3f724b2f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.833979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8961e5-a395-47cc-abda-c11d3f724b2f None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.836576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 272/542] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:44.844497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c6b8-321c-4070-8491-c684af920238 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:44.845363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c6b8-321c-4070-8491-c684af920238 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:44.845363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c6b8-321c-4070-8491-c684af920238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:44.876864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0f92c6b8-321c-4070-8491-c684af920238 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:44.879364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0f92c6b8-321c-4070-8491-c684af920238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:45.019328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 271/543] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:45.406158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5eba-025f-48e2-81c5-76905439006c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.409342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5eba-025f-48e2-81c5-76905439006c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.410165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb5eba-025f-48e2-81c5-76905439006c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.414802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 273/544] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:45.424203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:45.425154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:45.425926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:45.463011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:45.465564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:45.572809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 272/545] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:00:45.754279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb5eba-025f-48e2-81c5-76905439006c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:45.984985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb5eba-025f-48e2-81c5-76905439006c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.079257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.080390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.080779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.081248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.111457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:46.121321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.123113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:46.127230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 274/546] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.134789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.212319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.216312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.254710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.377466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b1bb-7557-4463-9ecb-7b8d6920c725 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.453506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.454879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.456094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.456739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.458823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda249d-b29a-4fce-9458-07419f2f5ff6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.460266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:46.462279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.464205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.482293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 273/547] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:46.491555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.539306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.540448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.542165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.542850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.570145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:46.581955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.583868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:46.585290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:46.599098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 275/548] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:46.602367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.766592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.784014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d0f5f-c75c-4fba-86db-20c63764decc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.830527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:46.874506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.877716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.879528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.880033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.889176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a374c23-0cef-4412-b70d-befa2df2f87a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:46.914163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.916932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.938545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:46.939987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:46.940463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:46.940925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:46.941816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:46.942439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:46.944093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:46.960045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 276/549] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:46.961736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:46.966906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:46.967884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:46.969765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:46.969765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:46.969765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:46.971034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 274/550] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:46.979605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.095169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa38852-0e0e-4860-916a-3a5cb9a37610 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.141331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.144190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.145006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.145759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.151851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.174421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.178193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-602562e2-ed89-42bb-a21e-d2e6c7583122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:47.208256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:47.209256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:47.210166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:47.210166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:47.210166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:47.214499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 277/551] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:47.214499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91590-1f7d-464a-a596-3234642ea64c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.214499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91590-1f7d-464a-a596-3234642ea64c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.214499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb91590-1f7d-464a-a596-3234642ea64c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.222285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 278/552] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:47.223950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91590-1f7d-464a-a596-3234642ea64c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.283479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d6da-c2fc-4a60-86e1-44a3a74697b9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.353425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.354390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.354842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.355248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.356395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:47.356890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.359433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8effa67-5248-4aac-94b5-ccfe194433b0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.384856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 275/553] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:47.384856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.384856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.384856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.407630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:47.408862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:47.411273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.416935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb91590-1f7d-464a-a596-3234642ea64c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.460522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.461372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.461372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.461674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.462327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:47.462615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.464007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5563f46-42c6-4b5b-9734-0fe8c4828496 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aab23-c8cc-419c-bb4f-5e364a9c6791 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aab23-c8cc-419c-bb4f-5e364a9c6791 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aab23-c8cc-419c-bb4f-5e364a9c6791 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 280/555] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:47.484048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aab23-c8cc-419c-bb4f-5e364a9c6791 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.506070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 276/556] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:47.519400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.570013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.654773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aab23-c8cc-419c-bb4f-5e364a9c6791 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.694847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990e3d-dde3-4cb5-b8ef-b7e6c41aabd9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:47.723194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.724457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.724859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.725254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.741569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.744735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.758984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:47.760050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.760549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.761037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-83cd2905-2a41-4257-af83-82eadecb33d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:47.772239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:47.773225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:47.774660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:47.775420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 281/557] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:47.775931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:47.777118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.777546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.778048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.778490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:47.780896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-db02e249-dfab-48e8-9d3d-6486c1f84da4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:47.796410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:47.804934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 277/558] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00822-b505-45e3-b199-433a475bb016 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:47.806359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00822-b505-45e3-b199-433a475bb016 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:47.807968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00822-b505-45e3-b199-433a475bb016 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:47.807968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 278/559] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:47.809352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00822-b505-45e3-b199-433a475bb016 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.813824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:47.817340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:47.932096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 282/560] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:47.933711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:47.956765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00822-b505-45e3-b199-433a475bb016 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.001132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e55425-f780-4565-a135-920a90495e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.002093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55425-f780-4565-a135-920a90495e00 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.002474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55425-f780-4565-a135-920a90495e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.002841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55425-f780-4565-a135-920a90495e00 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.003703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e55425-f780-4565-a135-920a90495e00 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.004091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e55425-f780-4565-a135-920a90495e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.005663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e55425-f780-4565-a135-920a90495e00 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.010239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.036820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 279/561] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.036820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.036820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.036820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.060120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:48.061941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:48.127363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416c54f-68a5-44b3-8fde-273dcf4acfc7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.137437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.165923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 280/562] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:48.165923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.204597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.205541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.206051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.206514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.208673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.209217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.212269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.254577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 283/563] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.255665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.379862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6a031-92be-42a7-96e9-2e46bad7f57c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.408017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.415669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc664d-598c-415a-b5d0-aa64c1b91d11 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.427332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.427988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.428266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.428540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.440517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:48.445456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.446536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:48.451558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 281/564] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.452497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.471815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.473030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.473320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.473596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.516855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.561559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.563643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.584682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58542d3-962b-49ab-8271-c379ce52904f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.622222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.622634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.622816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.623087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.638745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.640230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:48.663272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.665123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:48.667106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:48.667106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:48.667106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:48.667106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 282/565] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.667106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.673516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.684000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 284/566] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:00:48.685243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.789652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:48.794519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b89a-763c-424f-9d8b-0842f89f9b67 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.818139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5e199-e501-4a34-9295-132b67f2d55e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:48.842796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.845133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.845675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.846192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.855707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:48.856333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:48.856612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:48.856883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:48.857551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:48.857851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:48.859378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:48.864473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:48.868805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 285/567] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:48.869493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:48.871663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:48.873443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 283/568] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:48.877700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:48.971025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.005319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7536a-4909-4684-a91a-e080c78e9836 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.039122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32022-4d1f-44b2-8a9a-3b3a72530844 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.053396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.053935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.054220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.054525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.055174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.055475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.056870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.070140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 284/569] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.070995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.094107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.098166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.098810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.099078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.099348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.112334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:49.118664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.119704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:49.120564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 286/570] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.121261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.198627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fab33-1ba5-4104-a696-5f6f499c9e7f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.245994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.247130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.247601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.248055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.255433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974b57-e2f0-4241-99aa-3ca2f87eae50 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.267405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.270206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.275745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.287691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.295355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.297118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.297118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.297118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:49.297118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 285/571] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.297118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.297445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.297445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.297445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.297445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.308740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.310404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.327800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.330555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.332669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.332669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.332669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:49.332669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 287/572] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.332669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.374511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.415857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9dedba-87a9-4e64-9a7d-42eacd15f499 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.457475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72e040-64c5-4c00-8314-adba4c9c71c6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.467367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.468539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.468969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.469540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.470779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.471341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.473964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.489826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.489826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.502114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.502857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.503142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.503412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.513618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.515121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:49.528262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.529391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 288/574] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.530452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.575491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.617470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b7857-6cf2-45af-9bda-f83050c9b095 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.662140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3fe8e-c4e8-428e-9c95-4ba3ccc6fb3a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.662392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.669672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.670665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.671117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.677382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.677382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.677382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.677382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.689695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 287/575] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.690925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.713989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.714597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.714874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.715141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.715790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.716087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.717499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.729983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 289/576] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.730834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.810487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5e924-8251-4aa9-be05-0c225ab02601 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.839620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:49.849652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1306d-f7b3-414d-a37c-8ab82932a518 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:49.853302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.854469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.854972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.855466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.856667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:49.857216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.859493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.881259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 288/577] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:49.882808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.893609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:49.894309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:49.894594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:49.894861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:49.907705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:49.909229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:49.927322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:49.928511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:49.929418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:49.929418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:49.929418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:49.929418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 290/578] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:49.929921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:49.979858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.040542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12061a9-38c0-4fd8-bb83-3d8bc4db0ffe None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.074284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e61b9-0cc6-4d6d-bea1-9eaed57eb9f7 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.088597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.089680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.090158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.090651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.091978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.092379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.094403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.107506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 289/579] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:50.108371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.132421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.133130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.133445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.133780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.147418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.148902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.151149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:50.165755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.167847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:50.169588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:50.169588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:50.169588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:50.169588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 291/580] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.169588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.240932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fd57-e4db-4517-a172-4415358c25bc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.265643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.288022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.288672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.288918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.289193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.297577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.299314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.307894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df262d-cb74-4d49-be75-3edcb380e5ce None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:50.318791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.320150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:50.321439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 290/581] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.322438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.360798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.361363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.361644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.361955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.371569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.373264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:50.386040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:50.387981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:50.390120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 292/582] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:50.391606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.482598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.505594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3ab75-7a3e-4312-b6e3-7484c10867c4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.537142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d7c73-a402-4cb3-84ef-c129edff507e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.571379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.572427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.572922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.573413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.574553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.575095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.578596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.578951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.579827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.580106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.580378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e24a6be002b144dea05cfd340fdb173f/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.596935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=e24a6be002b144dea05cfd340fdb173f, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.598419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.607050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 291/583] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:50.607050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.649426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.694968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 293/584] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:50 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e24a6be002b144dea05cfd340fdb173f/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:50.696890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.753897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e2c81-54a6-4e70-bedc-2661b004938e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.824758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.826222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.826714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.827191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.829730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.830299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.832956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.848484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 292/585] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:50.849751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:50.905322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3d48d-25e3-4e39-9ae6-ab40d068ea8e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:50.909739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.967510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:50.969084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:50.969573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:50.970089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:50.971376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:50.971994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:50.974719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:50.986537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:50.996247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac60409-56cd-4cf7-a0d4-1cbb75e98ff0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.013927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 294/586] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.013927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.061624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.063209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.063947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.064436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.065952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.066462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.069178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.103329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 293/587] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.104618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.161679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829967ed-947b-4797-9101-a3c526d929ef None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.216914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.217843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.219200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.219695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.228342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.230071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:51.244728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:51.246556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:51.249030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:51.255192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 295/588] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:51.258440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.301382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e84c-a541-4134-b0df-fe8d45613cbf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.303780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.369254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.370345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.370826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.371315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.386502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.389355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.406416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406e34f-3847-49f7-9fb7-fd45dd2116e6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:51.415071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:51.416562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 294/589] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:51.418885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.448103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.459961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.460734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.461649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.462245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.471902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=2598eac7e63d4e4385d2c7510fa16528) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.471902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.471902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.482446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 296/590] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/role_assignments?user.id=2598eac7e63d4e4385d2c7510fa16528&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.482446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.625916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bc4cb-7ebd-4a2e-ac78-608e42dd2c49 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.699466 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:51.710101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.712122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.712832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.714069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.724566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f5ee-2857-4e7e-99a5-66e031d203c2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:51.743627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.746978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.771796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:51.772417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:51.772699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:51.772969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:51.773706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:51.774045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:51.775506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:51.778196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:51.780076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:51.783100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:51.783100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:51.783100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:51.786277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 295/591] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:51.788234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.813495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 297/592] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:51.815605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:51.930101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.013346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b5d7b-225d-4df6-85d4-c95242de9dc6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.026994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e690ea-a814-4413-a716-9f9e7345ae83 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.089926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.091031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.091540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.092518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.093635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.094301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.097391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.102406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.103790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.104543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.105303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.106978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.107829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.111889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.135501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 298/593] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.136961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 296/594] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 17 20:00:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.137764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.145379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.159551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.331381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf36c72-cd87-4595-9df5-5c99fbbf8ef3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.378467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f7654-f961-40ed-a01a-43f5c4c2b76a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.398430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.399721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.400342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.400954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.423123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.426072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.430297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.451030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.452488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.453264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.453977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:52.455536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:52.457517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:52.467474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:52.467474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:52.467474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:52.467474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 299/595] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:52.467474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.482444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.486463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:52.511463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:52.513211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:52.515049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:52.519982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 297/596] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:52.522273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.549969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.598327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a1758-8032-47cc-a2bf-9704db8ea219 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.637622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.638292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.638569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.638840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.652230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.653718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:52.669705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:52.672089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:52.674285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:52.674285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:52.674285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:52.674285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 300/597] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:52.674285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.763847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a203c8-411d-41a9-9d2f-288ee03d1513 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.787971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea534b5-66e9-4fdd-8774-0c299c5ab73a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.799622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:52.827067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.828677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.829681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.829979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.831065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.831848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.833912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.846247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:52.847764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:52.848462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:52.849135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:52.856787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 301/598] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.856787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.858401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:52.860371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:52.863284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:52.892452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 298/599] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:52.894402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:52.975558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37d44d-3267-4a7b-80f1-74fda6b9012e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:52.993769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.017183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.017745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.018201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.018611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.019384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:53.019790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.021389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.035590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 302/600] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:53.036883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.074106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.129518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006c4a-610b-4beb-b7a2-14088bdc332e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.159013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fbc8-6ebf-454d-8e6f-e0ac1b36c259 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.196829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.197574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.197927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.198270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.206784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.208481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.209678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.211387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.212179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.212911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/af188d89b2fe416884b5f80ff25b8d45/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:53.221985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:53.223706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 303/601] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:53.225470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.256459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=af188d89b2fe416884b5f80ff25b8d45, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.260265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.340721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.352313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacd3e5-65ff-4623-93d1-e5885fef4584 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.383077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 299/602] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:52 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/af188d89b2fe416884b5f80ff25b8d45/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:53.383365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.409129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.409786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.410098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.410421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.418391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.419924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-00d199cb-a11c-4fa4-a667-2362c1e7083d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:53.433032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:53.434163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:53.435288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:53.438052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 304/603] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:53.442241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc16fb-d5d9-4670-94b8-3b9f3a0e44a7 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.442967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc16fb-d5d9-4670-94b8-3b9f3a0e44a7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.443608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc16fb-d5d9-4670-94b8-3b9f3a0e44a7 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.446529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 305/604] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:53.448277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc16fb-d5d9-4670-94b8-3b9f3a0e44a7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.522845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.534791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0463-22e7-4089-8c66-24fd2d7e53a0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.604214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.605295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.605923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.606745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.608126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:53.609463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.612453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12735d46-d44c-4b02-a74f-4c0c440c37a0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.629909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 300/605] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:53.631275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.636840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.637130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.652331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc16fb-d5d9-4670-94b8-3b9f3a0e44a7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.662960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:53.665171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:53.697660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.698317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.698604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.698888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.699584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:53.699892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.701343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513998-86a6-4899-ad52-5e68ae5923b3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:53.715907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 306/606] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:53.722861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6135-4c79-4394-bdfe-1e30882eb969 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.723156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6135-4c79-4394-bdfe-1e30882eb969 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.723431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c6135-4c79-4394-bdfe-1e30882eb969 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.724797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 307/607] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:53.730242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6135-4c79-4394-bdfe-1e30882eb969 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.744926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:53.813749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 301/608] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:53.816277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:53.892195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c6135-4c79-4394-bdfe-1e30882eb969 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:53.963152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:53.964302 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:53.964793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:53.965303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:53.994319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=dd12e6654aad484d8edb0b82f86ba8ef, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:53.996989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48572b75-a560-403e-ad16-be653d1da892 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.003997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.019730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f95dc-a38d-4224-a385-75478b3ae3af None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.087372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.088474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.088944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.089392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/880635427a704e0e8107da0a07088237/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.115481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 308/609] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:53 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:54.118402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.118885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.119425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.128433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=880635427a704e0e8107da0a07088237, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:54.130969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:54.167766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:54.169996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:54.243386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 302/610] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:53 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/880635427a704e0e8107da0a07088237/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:54.302942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.322676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:54.360925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.568471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17762a09-43b4-484a-ada9-27243e5fdcdd None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.605376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:54.612755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.613419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.617063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.617063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.628294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:54.633282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:54.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:54.635844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:54.636831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 303/612] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:54.647386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.771211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:54.904680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae409c8-503c-4baf-be63-699e2219fe37 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:54.982817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:54.983698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:54.985097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:54.985599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:54.986897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:54.987439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.001155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.025087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 310/613] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.034137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.038272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f3869-aa85-4c27-b95b-53bb05c7ef43 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.118812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.119955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.124673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.125306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.158131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:55.167891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.168912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:55.169764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:55.171537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 304/614] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:55.178233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.178520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.295529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65611d-e8d3-4fab-83d7-bd03b03c63d9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.317854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.376671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.377322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.377597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.377865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.382182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a80f-88f8-470f-b058-ff58dae017a9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.403103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.404954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:55.436725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.438297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:55.439434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:55.439434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:55.439434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:55.447936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 311/615] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:55.451068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.453519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.453767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.454535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.455151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.456391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.456986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.459604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.477136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 305/616] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:55.489452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.660224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8822e1-da9b-4b54-9fe6-f9f9e5ebe188 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.674614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.719548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f27aa-aab5-4c4b-ba8a-34bcb02be533 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:55.751704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.752502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:55.752685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.752861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.753133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.753781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:55.754119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.755530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.784080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 312/617] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:00:55.789180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.801622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:55.802324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:55.802604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:55.802960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:55.816382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:55.817900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:55.834550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:55.835955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:55.837706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:55.837706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:55.837706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:55.840457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 306/618] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:55.843951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:55.959563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0154130-e762-4f34-b822-2dd00a21fd02 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.007076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.007622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.007887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.010682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.010682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:56.010682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.014281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.051231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 307/619] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:56.055775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.112031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.195346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6a13c-ad10-4547-8529-762cd574c9b5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.223620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127f77-f1e1-44a0-9e4b-9bd618cc1d6b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.239600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.240261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.240542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.240819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.250837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.252348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:56.273413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:56.275203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:00:56.277055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:56.286588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 308/620] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:56.293159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.400972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.402519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.403025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.406060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.433704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.435852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.441935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.457925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17b0f9-4c11-4c04-b861-ca89dfd23ac2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-e1347232-e42a-4fec-a129-1abf23a10f40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:56.502820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:56.503864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 20:00:56.504857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:56.509073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 313/621] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 720 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:56.511918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768c6-de04-4cd1-b087-3e7eafcc4ed5 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.512403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768c6-de04-4cd1-b087-3e7eafcc4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.512869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948768c6-de04-4cd1-b087-3e7eafcc4ed5 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.513256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.514711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.515218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.516188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.517464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:56.518253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.521265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba5784-6d5b-45c3-ba3e-2256481cbf83 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.528034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 314/622] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:56 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:56.529557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948768c6-de04-4cd1-b087-3e7eafcc4ed5 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.555011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 309/623] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:56.556869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.557342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.557849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.583781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:56.585743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:56.589376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.679293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 310/624] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:56.680582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.798692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948768c6-de04-4cd1-b087-3e7eafcc4ed5 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.817740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.840009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.840837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.841214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.841581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.842499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:56.842960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.844534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802732d1-8fc1-4cfa-aeb6-637be1911bdd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.853523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b544-a4bc-4b63-bf9b-fdcb1d53105a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:56.870287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 315/625] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:56.871854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad724-7e89-42b6-8bd7-8c4d77db7c5f None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.872238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad724-7e89-42b6-8bd7-8c4d77db7c5f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.872646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dad724-7e89-42b6-8bd7-8c4d77db7c5f None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.875169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 316/626] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:56.877051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dad724-7e89-42b6-8bd7-8c4d77db7c5f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:56.896465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:56.897371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.897837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.898296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.910482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:56.912243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-438be7c1-5d5b-4bc9-96b8-32286be737d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:56.929562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:56.930783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:56.931870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:56.931870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:56.931870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:56.938797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 311/627] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:56.940495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:56.940944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:56.941398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:56.961312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:56.962989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:56.976617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:56.998662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dad724-7e89-42b6-8bd7-8c4d77db7c5f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.040217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.041174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.041611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.042129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.046263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 312/628] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:57.048100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.125203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.126212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.127669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.207726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6204bc-c556-4eb8-a7dc-9e27bee2752a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.221723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.243584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 317/629] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 20:00:57.250635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.283390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.284026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.284300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.284577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.285363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.285669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.287148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.305336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 313/630] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.306362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.368512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f3cb-912e-4611-81b9-32f8bbdb7cea None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.408522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.409176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.409450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.409712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.422313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.423868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:57.440585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.442456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:57.444215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:57.444215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:57.444215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:57.446461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 318/631] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:00:57.447428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.488243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.506508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbedbe1-70d5-4f8a-8d0a-9ef49d2fd948 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.540346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.565524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.566219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.566495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.566762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.580041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb9f0-def0-4862-a9f3-623ab5038048 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.580552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:57.585913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.587552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 314/632] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.589201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.627099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.627764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.628041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.628310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.635958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.637457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-cbf1ebd6-7311-44e0-a76a-f7517c55fe29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:57.650892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.652174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 319/633] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3f93-a677-488e-856b-05a3213d0f56 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.653937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3f93-a677-488e-856b-05a3213d0f56 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.655184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb3f93-a677-488e-856b-05a3213d0f56 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.655326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 320/634] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:00:57.656252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb3f93-a677-488e-856b-05a3213d0f56 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.720184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61458393-fc39-4976-bc3e-56364de121b1 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.758423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.759063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.759348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.759623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.760313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.760613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.762137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.776368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 315/635] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.778098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.788227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.797190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb3f93-a677-488e-856b-05a3213d0f56 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.826008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:57.836464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.837114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.837388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.837655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.851061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:57.855951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:57.858052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 321/636] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:57.861388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:57.903743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d8f2c-28ac-45b3-b1fa-d564a076005e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.943398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:57.944020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.944306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.944582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.945328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:57.945640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:57.947149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13a8f-b76c-46ae-a953-d961446d15e6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:57.956407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 316/637] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:57.957675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:57.957987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:57.958258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:57.977994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:00:57.978964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8059e-15b0-40f5-aa45-68982865fb5c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:57.979375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:00:58.031352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.032221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.032675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.033105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.033911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.034418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.036924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.052723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 322/638] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.053607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.071696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.075141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 317/639] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:00:58.076034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.108999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.178057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4630ce-ebbb-4d31-be58-f2f0fbca9c65 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.198414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b55531-f969-4c3e-8e43-0155b8fc3e61 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.220467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.221528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.221811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.222119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.230520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.231888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.241150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.245633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:00:58.246461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:58.249669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 323/640] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:58.251723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.277934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 318/641] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.277934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.364524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.392866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9226d16-81de-48be-8cdf-6688716e3e0c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.393548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.403892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6426f-b962-4850-9dfa-4edaa2a433e1 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.435270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.436334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.437290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.437781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.451313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.452930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.453385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.453813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/2598eac7e63d4e4385d2c7510fa16528/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.455102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.457690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.476860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=2598eac7e63d4e4385d2c7510fa16528, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:58.478262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:58.480110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:58.482507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:58.482507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:58.482507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:58.483246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.483896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 324/642] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:58.483896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.551709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 319/643] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:00:58 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/2598eac7e63d4e4385d2c7510fa16528/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:00:58.553177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.624942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f45-f27c-4b8b-8261-9e02a22b1ef2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.665492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.679938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.681033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.681499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.683949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.683949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:58.684184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.687193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.703559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 325/644] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:58.705355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.721345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66280970-ab37-4aae-8d46-f56b625a7b51 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.775788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.776601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.777130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.777597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.790136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:58.794126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:58.797065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:58.818413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:58.820497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:58.823271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:58.823271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:58.823271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:58.823271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 320/645] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:58.827856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:58.907256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0df70-338e-4236-bb07-af61c6a7e40a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.967089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26984d14-f7b5-441c-9efd-041339b25445 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:58.970450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:58.971174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:58.971465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:58.971736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:58.984597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:00:58.989981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:58.992203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 326/646] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:58.993941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.050119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.050759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.051208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.052178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.052683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.053933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.054500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.057178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.075129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 321/647] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.076661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.141471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.143813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2edc-dbbc-4bd8-ab0b-99a03c1fed37 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.184816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.185531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.185816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.186203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.187764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e24a6be002b144dea05cfd340fdb173f) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.188199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.189598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.206010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 327/648] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:00:58 2022] GET /identity/v3/role_assignments?user.id=e24a6be002b144dea05cfd340fdb173f&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.206010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.218844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee75754-1328-49f9-a9de-e7fae692f452 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.281781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.282444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.282722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.282988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.283648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.283944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.285388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.318824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 322/649] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.320868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.321469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a74d-4e61-4d6d-8dab-6ae8af1c5258 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.335147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.364903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.365602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.365912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.366199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.367206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.367513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.368984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.379914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 328/650] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.380780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.514350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bad3c-d09f-4674-9df1-b0a580a06372 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.518441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24919e3-143f-491d-9685-d6f5c44092e4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.530606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.567787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.568448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.568737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.569125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.575019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.575840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.576218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.576588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.578855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.580360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:59.593731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:59.595550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 323/651] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:59.596669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.605341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.609781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:00:59.636613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:59.638685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:00:59.641141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:00:59.650051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 329/652] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:59.652137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.711190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37c51-654a-49bf-b1df-212b9c214ab2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.721129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.750191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.750845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.751129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.751386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.763827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.765892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:00:59.782455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:00:59.784583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:00:59.786712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:00:59.786712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:00:59.786712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:00:59.786712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 324/653] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:00:59.786712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:00:59.816768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:00:59.880391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a8e2a-d335-4e85-8586-c807b15d288e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.905037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855a99c-eef4-44fb-8e59-c1be73fa0c1b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:00:59.943983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.944798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.945068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.945431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.946276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.946660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.948310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.952980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:00:59.954581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:00:59.955253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:00:59.955910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:00:59.957469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:00:59.958601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:00:59.961843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:00:59.973988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 325/654] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:00:59.973988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.002193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 330/655] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:00.004392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.076101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.099240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492538-f9d8-4018-93bc-09f61626bf05 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.172052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.181210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.182654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.182938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.185662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.185662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:00.185662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.185662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.193306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea061854-fd14-4f3b-a6dd-e27292befeb8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.201450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 326/656] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:00.201801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.283778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.284265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.284577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.284828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.351755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f3486-0495-47f6-a217-a55978c61c5b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.394888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.395516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.395804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.396072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.411155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.423982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.427985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.478388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.479902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.599762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 327/657] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:00.600636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.609486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.637245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 331/658] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:00.639444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.652537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:00.721416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de704e1f-78ba-435f-9976-d5443291af77 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.762048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.762761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.763047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.763321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.773150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.774772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:00.788242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:00.790667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 328/659] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:00.793148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:00.832138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4e391-b902-40f6-ac7a-2a6cfa58d6d0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:00.874740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:00.875395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:00.875677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:00.875943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:00.888365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:00.890742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:00.932206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:00.934387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:00.936498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:00.936498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:00.936498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:00.940345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 332/660] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:00.942556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.010606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7486e1-fa41-4903-83c7-7c5af54207aa None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.012711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.016960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.082854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.085757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.088067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.088762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.097485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2f148-10b6-4c3f-9f27-574173668f90 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.120370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.124836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.141676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.142473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.142873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.143251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.144113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:01.145126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.146206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:01.157108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:01.159251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:01.161502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:01.161502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:01.161502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:01.165551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 329/661] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:01.166693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.195563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 333/662] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 17 20:01:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:01.198209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.331985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.335929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c9b8-e12c-4ad4-bd3a-423ad020fe48 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.385146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1733b-5eed-4f16-aec1-d8927f48e05f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.398652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.401310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.402243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.403290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.406593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:01.407829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.411534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.428782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678961cf-60de-43b3-800e-3061671491fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.429410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678961cf-60de-43b3-800e-3061671491fc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.429692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678961cf-60de-43b3-800e-3061671491fc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.429997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678961cf-60de-43b3-800e-3061671491fc None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.430650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678961cf-60de-43b3-800e-3061671491fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:01.430954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678961cf-60de-43b3-800e-3061671491fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.432373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678961cf-60de-43b3-800e-3061671491fc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.440332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 334/663] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:01.441930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.451552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 330/664] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:01.454569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f674-afc6-42ea-bc94-54dc40c9863e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.455992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f674-afc6-42ea-bc94-54dc40c9863e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.456861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f674-afc6-42ea-bc94-54dc40c9863e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.460651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 331/665] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:01.462558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f674-afc6-42ea-bc94-54dc40c9863e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.492334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.573652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca0ee-7263-42c7-bc51-e40955a2e11a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.620018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f674-afc6-42ea-bc94-54dc40c9863e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.634210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.635146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.635544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.635948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.681366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.681747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.682687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.683149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.683628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.697787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.700752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:01.721499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:01.731146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 332/666] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:01.733352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.763609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.765790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae56ea-d0aa-45f1-8681-cde1144dd9cb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.840285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.872631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47d17-6d52-4426-b045-70d561c4651d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:01.894887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 335/667] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:01.894887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de97ab-b081-4a8e-a96c-a278f9003a1e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.894887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de97ab-b081-4a8e-a96c-a278f9003a1e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.894887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de97ab-b081-4a8e-a96c-a278f9003a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.914770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e5de97ab-b081-4a8e-a96c-a278f9003a1e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:01.916119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e5de97ab-b081-4a8e-a96c-a278f9003a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:01.926772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:01.927552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.927969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.928364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:01.937017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:01.938873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:01.952995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:01.955011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 333/668] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:01.957100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:01.984821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:01.996498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 336/669] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:01.997918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e23e8-e6ea-4714-9951-b747cc91ce51 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:01.998233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e23e8-e6ea-4714-9951-b747cc91ce51 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:01.999016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e23e8-e6ea-4714-9951-b747cc91ce51 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.004698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 337/670] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:02.005621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e23e8-e6ea-4714-9951-b747cc91ce51 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.125501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54536ad0-55dd-4b54-a938-b48de2f2c643 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.160545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e23e8-e6ea-4714-9951-b747cc91ce51 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.187354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.188393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.188893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.189373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.190719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.191258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.194050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.197508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.211971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.223731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.223731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.223731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.224232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 334/671] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.224232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.239770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.242538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-03b9e460-d45b-448a-aeef-16102574a39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:02.276169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:02.277238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:02.278389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:02.278389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:02.278389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:02.282208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 338/672] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:02.286133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.286919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.287801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.320184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:02.321746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:02.374375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.378697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cab31-16fd-4acc-aad4-b3b650989ca7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.426540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 339/673] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:02.426540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.429724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.430713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.431160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.431593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.432760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.433254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.436947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.462547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 335/674] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.462547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.562217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.610921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff1a8-5cab-4a2e-ba64-b412619f60a3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.628093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c00ec-0a4a-48ea-8f91-52053cc3a47a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.674368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.675228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.675686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.676001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.676707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.677038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.678727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.684800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.686452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.687427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.688127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.689449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.690042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.692831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.700932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 336/675] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.700932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.709072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 340/676] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.710597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.778503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.895548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774fd26-d23f-4325-891a-5606a051a27f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.919379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88a12-a155-4169-8623-d6297b28024a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:02.940524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.941410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.941852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.942352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.944178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=af188d89b2fe416884b5f80ff25b8d45) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:02.944178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.945703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:02.946568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:02.955459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 341/677] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/role_assignments?user.id=af188d89b2fe416884b5f80ff25b8d45&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:02.957951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:02.971132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:02.971792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:02.972077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:02.972348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:02.987043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:02.989841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:03.013511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:03.016181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:03.018220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:03.018220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:03.018220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:03.018220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 337/678] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:03.018981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.138413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.142828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6284721-3169-406a-8995-0d4c87922504 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.193454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.194838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.195340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.196429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.200969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16101b27-8e27-44f4-9596-d04a17806e3a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.207752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.209359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:03.223938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:03.225700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 342/679] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:03.227543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.283121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.284239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.284721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.285178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.308362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:03.317956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:03.319863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 338/680] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:03.321599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.383906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.419686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd25ba-19cb-4d8c-82fe-89e8d0d72a0d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.471446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.472389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.472857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.473334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.474290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.474787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.476433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.495278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 343/681] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.496539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.524838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.537725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac689a9-a4c3-48f5-9737-b687e5c286ed None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.586309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.587035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.587404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.587684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.588480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.589300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.590701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.618012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 339/682] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.618012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.682751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80762ed4-9f54-4020-88ff-60ea0f3c5c9c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.745367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.746133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.746508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.746884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.747666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:03.748082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.750639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.769916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 344/683] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:03.769916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.801168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.820304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8cf0e-6dac-44ae-9b89-5a57f1a39149 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:03.862007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:03.862635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:03.862914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:03.863173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:03.863812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:03.865269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:03.939513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:03.951264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 340/684] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:01:03 2022] POST /identity/v3/users => generated 254 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:03.954352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:03.993170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460536b-f076-4662-938d-5627e01b1aeb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.066018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.066018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.066018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.066018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.067093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=880635427a704e0e8107da0a07088237) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:04.067640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.070496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.083788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 345/685] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/role_assignments?user.id=880635427a704e0e8107da0a07088237&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:04.231349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6135863-a576-4ae2-a30b-b66f99260c99 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.292183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.292840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.293109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.293381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.308293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.309798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.312572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:04.330684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.331898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:04.333406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:04.333406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:04.333406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:04.333406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 341/686] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.343875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.474325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed672ed-64c6-41cd-a497-ff8d862c1e79 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.526964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.528509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.529859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.530614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.532101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:04.532845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.535467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.561954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 346/687] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:04.568054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.696779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b8df-c862-4672-9292-51470b240035 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:04.741934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:04.742603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:04.742919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:04.743172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:04.752322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:04.753805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:04.770473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:04.772322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:04.775143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:04.779042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 342/688] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:04.781271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:04.809967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:04.974843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528526f8-3891-4ff2-988d-c7d7c9f24bdf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.031974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.032618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.032905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.033177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.034015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:05.034326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.035784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.066327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 347/689] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:05.067946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.177745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.271002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d012-2971-40cd-b07e-c350ad44d541 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.328328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.328954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.329235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.329507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.430013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.431573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.505938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.564840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 343/690] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:05.573482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.677445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:05.739973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312173aa-5f80-4df9-b2a5-289965356a6c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:05.793418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:05.794091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.794343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.794610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.815165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:05.816563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3438a200-c387-4777-809a-e6837e22c9c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:05.838154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:05.839193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:05.840091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:05.840091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:05.840091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:05.840091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 348/691] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:05.848143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:05.988864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b5bc-a67c-4f88-a922-5f36a27349fd None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.989061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b5bc-a67c-4f88-a922-5f36a27349fd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.989284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161b5bc-a67c-4f88-a922-5f36a27349fd None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:05.990930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 349/692] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:05.996227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab28b-225d-4378-bd75-5004cc3d8305 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:05.996506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab28b-225d-4378-bd75-5004cc3d8305 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:05.996777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ab28b-225d-4378-bd75-5004cc3d8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.004232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21afeb-3db6-4ea2-bcf7-22ce96df7892 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.044198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.046180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.046736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.047221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.048067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.048665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.048777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7e8ab28b-225d-4378-bd75-5004cc3d8305 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:06.050472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd4738-4588-443f-98cc-e9fbd7d07452 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.050914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7e8ab28b-225d-4378-bd75-5004cc3d8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:06.064824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 344/693] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.077855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d536-c2fb-453f-921a-558f3b7933a9 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.077855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d536-c2fb-453f-921a-558f3b7933a9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.077855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195d536-c2fb-453f-921a-558f3b7933a9 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.077855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 345/694] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:06.078436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195d536-c2fb-453f-921a-558f3b7933a9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.096349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.146359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 350/695] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 20:01:06.151433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.151926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.152351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.194968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:06.196474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:06.197300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195d536-c2fb-453f-921a-558f3b7933a9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.246429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.276253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 351/696] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:06.298670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.299334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.299613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.299885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.315247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.316794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:06.348163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:06.349719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:06.351342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 346/697] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:06.362705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.515657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.605087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6bc5-98c5-4950-9107-995431f4d7f9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.666540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.677389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.682728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.700594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c9ef5-7c27-4263-8a34-d4b44f9dad70 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.706004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 352/698] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:06.706993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.757687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.758891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.759141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:06.759369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.760976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.780427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:06.789657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:06.790738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 347/699] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:06.792227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.854737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f57b69-c620-472f-b9c0-fbfc71a7a51b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:06.916938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:06.918383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.918383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.918726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.919084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:06.922002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-20151b40-e3f2-4286-a4a4-25f298932298 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:06.940013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:06.942032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:06.943635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 353/700] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:06.945146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5c1c-8e4a-4d60-b84c-aceb5df414ca None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:06.945146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5c1c-8e4a-4d60-b84c-aceb5df414ca None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:06.945146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e5c1c-8e4a-4d60-b84c-aceb5df414ca None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:06.947545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 354/701] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:06.949706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e5c1c-8e4a-4d60-b84c-aceb5df414ca None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:06.963005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8777d09-9c9b-4c61-8fbb-be0abd70c648 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.025324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.025990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.026276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.026538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.027298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=2598eac7e63d4e4385d2c7510fa16528) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.027606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.029701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.032198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.040643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 348/702] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/role_assignments?user.id=2598eac7e63d4e4385d2c7510fa16528&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.044217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.159983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.165263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e5c1c-8e4a-4d60-b84c-aceb5df414ca None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.207873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.208456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.208855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.209011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.209658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.209986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.211410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0aaab7-7951-4bc8-adcf-9df7921a4b27 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.226027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 355/703] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.226234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c302b7-a63d-45c2-8de5-cdfb9cb2dbef None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.226352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.226352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.226352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.246715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:07.248957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:07.292778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.293519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.293901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.294163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.296269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.296269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.297940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71179a25-cd32-4581-9f35-21e0540c6ab3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.303448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 349/704] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.304797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb88a0-3dbc-49d5-8b9a-889e1c854f33 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.305078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb88a0-3dbc-49d5-8b9a-889e1c854f33 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.305351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb88a0-3dbc-49d5-8b9a-889e1c854f33 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.306805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 350/705] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:07.307604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb88a0-3dbc-49d5-8b9a-889e1c854f33 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.377942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 356/706] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:07.377942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.430236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.510462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb88a0-3dbc-49d5-8b9a-889e1c854f33 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.522137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.532908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451bd16-2575-4470-a845-6d2503c840f4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.576097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.576745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.577025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.577397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.578077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.578346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.578529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.579431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.579771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306a33-12b9-4a5a-b61e-037aedb44395 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.580026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.580452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.587077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 357/707] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.588430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.588717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.588993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.610407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:07.611670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:07.621515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.624393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:07.677430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:07.681046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:07.688035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:07.688035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:07.688035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:07.688035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 351/708] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:07.693945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.703849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 358/709] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:07.880463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b0457-325d-49f7-911b-0e13d2ab1cfe None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:07.906123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:07.940011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:07.941003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:07.941479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:07.941990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:07.943157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:07.943679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:07.946364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:07.951857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:07.970406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 352/710] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:07.979007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.167893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.216694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d9ce1c-111f-41d0-a336-1247aa14504c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.222958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834e7a2-abc3-4a4b-a5cf-ebe9d0c932d2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.313288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.314359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.314806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.315264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.316782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.318808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:08.343489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:08.345402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:08.347112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 359/711] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/services/network => generated 88 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:08.350459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.351769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.353345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.354214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.354693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.370220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.373216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:08.399846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:08.401628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 353/712] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:08.404821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.472018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.545440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7034d-08a8-4d70-afc8-eea72959f7e4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.616457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8d5ed-7dd8-4f73-9335-287b60da8db1 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.616883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.618026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.618527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.619022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.645013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:08.657960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:08.659680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:08.661213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:08.665990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 360/713] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:08.667926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.693780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.695465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.696310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.697090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.698291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.698973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:08.699817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.703602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:08.713135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 354/714] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:08.715040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:08.894905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e843eaf-c38b-4964-ae5f-027d659c9ff4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.939319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:08.949169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4368f-cae5-4c0b-8895-4d88204291a8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:08.964081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:08.966249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:08.967052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:08.967810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:08.969550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:08.970529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:08.973758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.014419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 361/715] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:09.015957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.021593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.023694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.024486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.025275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.026900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:09.027742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.031581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.053486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 355/716] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:09.055552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.123876 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.182906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec0547-60b1-420b-99d2-35c2353b8d72 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.217745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2d67f-05f0-46f6-809f-c63aaf5d857e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.245772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.247540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.248332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.249086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.250555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] RBAC: Adding query filter params (type=network) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:09.251658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.254919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.273927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 362/717] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:09.273927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.284789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.285683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.286130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.286541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.343252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.467371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.468779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.489534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49adaa24-0ffe-49bd-9a09-629492332e79 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.551498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.561081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.565559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.565559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.565559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.585995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.589047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:09.622172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:09.624607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:09.626357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:09.626357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:09.626357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:09.631097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 363/718] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:09.638637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.666139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 356/719] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:09.672835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.787453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:09.837657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeec6b-b742-4ef6-834b-d5b53763fbc4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.883565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.884223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.884503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.884776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.887592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538274b-ba44-4a33-a8fe-56223203e78a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:09.909466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.911005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:09.941832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:09.943699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:09.945542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:09.945542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:09.945542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:09.945542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 357/720] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:09.954973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:09.979061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:09.981431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:09.984629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:09.985748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:09.987577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:09.990320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:09.995383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.047535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 364/721] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:10.053217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.143501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.203056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24d690-8488-4e8d-a80d-e50d79512ec2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.205050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb21a4-8017-4dbb-bb89-13a3d1624e4c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.233545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.249555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.250245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.250525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.250796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.264477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.266035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b97e11f4-c9e3-4676-b688-a000c9847d07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:10.278987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:10.280908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 365/722] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c375-002f-4a97-b5d0-7e86656a7eda None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.282819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c375-002f-4a97-b5d0-7e86656a7eda None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.284218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c375-002f-4a97-b5d0-7e86656a7eda None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.284218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 366/723] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:10.289922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c375-002f-4a97-b5d0-7e86656a7eda None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.298737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.299278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.299564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.299833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.300475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:10.300777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.302228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9d78c-2c18-440b-b7fb-396c3f99afb9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.323616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 358/724] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:10.326466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.327387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.328135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.363015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:10.365582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:10.416711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c375-002f-4a97-b5d0-7e86656a7eda None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.420031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.456385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.457371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.457371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.457695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.458354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:10.458651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.460272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.481999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 367/725] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:10.483157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.520056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 359/726] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:10.522432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.600442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd0164-5208-4bd3-b945-a232ce24a845 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.642330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.642978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.643257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.643523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.657027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.658538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:10.671547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:10.672619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:10.674462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 368/727] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:10.683485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:10.748899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.791489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe59e4-5763-4ac3-abd8-847e9616b318 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.793500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:10.865041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56209c6-a41e-4ed7-9684-85ef3f4ee85b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:10.868305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.868951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.869235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.869514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.905939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:10.906578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:10.906864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:10.907136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:10.907860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:10.908167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:10.909663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:10.926681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 369/728] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:10.935660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.018015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.020037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538cf7c-622c-4429-8042-d72d474fd138 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.106259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.147915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ede5c6-6c79-4e3b-8348-73c64322423c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 360/729] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b52d9-eba7-4e96-adad-50780bd631fc None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b52d9-eba7-4e96-adad-50780bd631fc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b52d9-eba7-4e96-adad-50780bd631fc None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 361/730] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:11.161269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b52d9-eba7-4e96-adad-50780bd631fc None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.165432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.220810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.221860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.222395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.222872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.224265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.224804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.227387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.246135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 370/731] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:10 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.246135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.304374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b52d9-eba7-4e96-adad-50780bd631fc None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.349226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.350317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.350788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.351256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.364766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-acc0b638-440e-46a2-aae9-e16bcc7f91cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:11.370361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:11.371385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:11.372246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:11.378358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 362/732] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:11.379980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.380463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.380923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.401009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:11.402588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:11.474947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.488662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9f55a-96c1-4241-a614-e00039e7df23 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.493643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 363/733] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:11.495018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.596962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.598093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.598539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.599029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.636388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.642200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.671692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-c1af1600-295e-4041-ba19-85d8763d1076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:11.703626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:11.704657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:11.705561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:11.705561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:11.705561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:11.706690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 371/734] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:11.709160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa5cb-0e5c-4905-9ce6-0c8fbf71a244 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.709670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa5cb-0e5c-4905-9ce6-0c8fbf71a244 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.718487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa5cb-0e5c-4905-9ce6-0c8fbf71a244 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.721967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 372/735] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:11.723454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aa5cb-0e5c-4905-9ce6-0c8fbf71a244 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.750653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ed462-971f-4901-b7a4-baeae89b5dc7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.820036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.821082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.821581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.822100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.823344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.823883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.828550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af84224-33d7-4fdb-8a7b-16ce90190771 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.850053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 364/736] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.850053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.850053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.850053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.866391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:11.867620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:11.899515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aa5cb-0e5c-4905-9ce6-0c8fbf71a244 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:11.931685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:11.969779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 365/737] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 20:01:11.969779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:11.975180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:11.975814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:11.976100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:11.976373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:11.977035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:11.977340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:11.978814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:11.996301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 373/738] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:11.997816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.078313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.130451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d74f77-48af-44b6-abcb-db11c62544b9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.132125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b7f34-8548-443c-b06b-47d4a9ada5fc None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.179235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.180472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.180924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.181348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.195052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.196552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.196859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.197978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.198560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.199218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.200488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.202139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:12.214225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:12.216691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:12.219794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:12.219794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:12.219794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:12.219794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 374/739] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:12.219794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.326890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 366/740] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:11 2022] POST /identity/v3/services => generated 251 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:12.330365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.433026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.449122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aff4cf-eaae-417b-9179-243e691cd899 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.465788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.521165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.522369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.522839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.523374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.524129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246266e-a450-4d2a-a152-a8951460ae01 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.534216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.536471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:12.548680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:12.550343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 375/741] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:12.552131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.578435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.579076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.579349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.579616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.580273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.580698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.582519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.604852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 367/742] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.606639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.698051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a777f8-201c-4b64-ab7e-65c63dc98d77 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.740765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.741301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.741581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.741853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.742549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.744068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.751203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cf3b8-4aca-42d6-bb46-94659d54831a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:12.754743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:12.795618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:12.797174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:12.797650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:12.798367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:12.800072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:12.800852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:12.804074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:12.827665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 368/743] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:12.829199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.840632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 376/744] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:12 2022] POST /identity/v3/services => generated 240 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:12.845916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:12.921092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.001347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417f41e-aac9-4b92-ba62-7a500afd924f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.089041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f2b7a-9e8d-4959-a9e6-53cb135d9a95 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.096480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.097572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.098144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.098669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.116396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.120914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.132314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.133666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.134188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.134622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.135533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e5e97d95774e4618a71c8b864d29dc3a) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:13.135989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.137613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.146329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 377/745] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/role_assignments?user.id=e5e97d95774e4618a71c8b864d29dc3a&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-5d7fc41a-e0ba-4965-9582-27f37c151d97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:13.149908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:13.150945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:13.151900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 369/746] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:13.155449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.351717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.377802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa2e44-f641-4375-bcb3-8bf942849148 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.400188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3805-de98-4dcd-8732-6086474f0fce None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.400703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3805-de98-4dcd-8732-6086474f0fce None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.400817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3805-de98-4dcd-8732-6086474f0fce None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.405257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 370/747] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:13.411113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.411543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.411907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.426863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.427828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.428421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.429796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.430753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:13.431117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.434149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.463136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:13.464397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:13.469927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 378/748] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:13.480505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:13.504195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.669501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 371/749] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:13.719458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c947e2-e0a2-4c53-be7b-2e22dd199838 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:13.777218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:13.777847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:13.778156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:13.778495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:13.801781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:13.871217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:13.873596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:13.997048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 379/750] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:14.005262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.222721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.236402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57938567-e03a-4e93-9d10-e97c2decadc4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.302070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.303211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.303890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.304257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.337694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.339619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.363053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:14.380725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:14.382654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:14.384419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:14.384419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:14.384419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:14.387969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 372/751] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:14.399183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.404800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.531433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cdd88-b418-4ed3-a41b-cb558052c5cf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.609636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.610322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.610603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.610874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.647546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:14.657899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30497f28-a2f3-49f4-8f70-13911af041df None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:14.658114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:14.659016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:14.659889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:14.660549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 380/752] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:14.671997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.753433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.754511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.755004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.755478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.756669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.757204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.759806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.783142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 373/753] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:14.791664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:14.873003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c988e-f3ad-404c-b8f0-563550f48890 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:14.876883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.924282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:14.924904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.925187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.925463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.926179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:14.926287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:14.926485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:14.928281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e8aff-247c-405d-8219-c4b574395d29 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:14.938015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 381/754] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:14.939463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023540bb-a789-48b0-a64e-d37646dc9a8a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:14.939862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023540bb-a789-48b0-a64e-d37646dc9a8a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:14.940048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023540bb-a789-48b0-a64e-d37646dc9a8a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:14.941595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 382/755] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:14.946845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023540bb-a789-48b0-a64e-d37646dc9a8a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.002766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665135d9-1994-490e-a864-725e89c0a687 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.066297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.067618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.068080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.068518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.082772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.085361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-16b00b45-76bc-4462-abcf-9005fb13cdd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:15.108384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:15.109490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:15.110465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:15.115920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 374/756] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:15.118212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.118683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.119157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.154159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023540bb-a789-48b0-a64e-d37646dc9a8a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.157823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:15.160122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:15.218262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.219295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.219752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.220211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.241554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.244267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:15.272616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:15.274937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:15.277064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:15.277064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:15.277064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:15.285924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 383/757] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:15.285924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.310901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 375/758] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:15.312067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.317677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.433996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.439037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f496fe-ecf4-4a85-975c-e172cb95ede3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.479615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.480374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.480651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.480914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.482190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.482496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.484416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.505996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 384/759] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.511193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.569720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500878e-f293-4ea2-ab5a-bc20e0b784b8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.613454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.634593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e327d-adfa-4c41-b16f-80657cc1943e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.656038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.658318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.659165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.659875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.661294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.662318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.663758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.683328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.684003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.684281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.684748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.685644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=2598eac7e63d4e4385d2c7510fa16528) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:15.685988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.687451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.701915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 385/760] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/role_assignments?user.id=2598eac7e63d4e4385d2c7510fa16528&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.701915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.705701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 376/761] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:15.711002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.891636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd0a9-1cc0-4450-8977-9070c1587881 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.932537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.932537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.932961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.933091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.937910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.937910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:15.940254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cd9e3-796d-449d-8038-d2940e4a910e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-8edc4079-d28c-43f9-b432-acf939dc0c82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:15.946037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:15.947076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:15.947949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 386/762] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:15.948770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968ee8-e0bc-4d40-8f01-5ac05d1ad80a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.949062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968ee8-e0bc-4d40-8f01-5ac05d1ad80a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.949338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31968ee8-e0bc-4d40-8f01-5ac05d1ad80a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.954048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 387/763] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:15.955393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c5eb-16fb-46f8-a7fe-2ceba3eb10ee None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.955683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c5eb-16fb-46f8-a7fe-2ceba3eb10ee None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.955960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727c5eb-16fb-46f8-a7fe-2ceba3eb10ee None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.957313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 388/764] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:15.958677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727c5eb-16fb-46f8-a7fe-2ceba3eb10ee None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:15.959612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.970128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:15.984403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:15.985058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:15.985367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:15.985648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:15.994632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:15.996132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b1c1bb29-b6f1-49dc-b5c7-699c4c1f5624 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:16.018403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.019419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:16.020408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 377/765] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.026285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10107-f533-4a96-9f1d-47590072095a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.026285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10107-f533-4a96-9f1d-47590072095a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.026285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc10107-f533-4a96-9f1d-47590072095a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.054755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9fc10107-f533-4a96-9f1d-47590072095a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:16.057979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9fc10107-f533-4a96-9f1d-47590072095a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:16.087444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727c5eb-16fb-46f8-a7fe-2ceba3eb10ee None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.142674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.143736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.144059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.144608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.146027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:16.146658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.149141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.159749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 378/766] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:16.159749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced676-9778-4e33-82dd-503919dde471 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.159749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced676-9778-4e33-82dd-503919dde471 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.159749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced676-9778-4e33-82dd-503919dde471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.168211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 389/767] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:16.170101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.196083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dbced676-9778-4e33-82dd-503919dde471 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:16.197419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dbced676-9778-4e33-82dd-503919dde471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:16.277922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 379/768] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:16.277922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced676-9778-4e33-82dd-503919dde471 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.308421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.357554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.397440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced676-9778-4e33-82dd-503919dde471 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.456011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325cee5-d437-4561-8549-11507078d9f0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.494472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.495604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.496155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.496628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.497942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:16.498720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.501638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.515789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.516764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.517253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.517757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.518388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 380/769] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:16.518981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:16.519494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.520140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.521389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.549133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 390/770] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:16.549133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.683274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.683671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5c25-9f11-40e4-bcc4-2c1185773057 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.694388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792deff0-4616-424e-a2a3-1ce1f0da9afb None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.715065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:16.723893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.724673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.724959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.730638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.730638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] RBAC: Adding query filter params (interface=public, service_id=ad2995e614924d4eabe4ad3a92de5bc5, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:16.730638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.730638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.740933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 391/771] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/endpoints?service_id=ad2995e614924d4eabe4ad3a92de5bc5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:16.740933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.761423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.762426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.763306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.763582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.776308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:16.782252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.784039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:16.785755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:16.788314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 381/772] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.789106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.877978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27c141-2569-421b-a884-df90a4b51d9d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.908580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204ca62-be7f-425d-90f6-6e64040d7201 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:16.913834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.914519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.914800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.915069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.927063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.928554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:16.944417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.945759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:16.947541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:16.947541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:16.947541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:16.947541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 392/773] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.947541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:16.957405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:16.958299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:16.958713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:16.959121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:16.960112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:16.961771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:16.975635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:16.977623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:16.979390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 382/774] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:16.981015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.007886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.011837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.082796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a934c8-b162-40d2-b978-141f8baaec31 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.099425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e3072-bbe8-452e-81ca-140db16085e8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.135463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.136578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.137007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.138651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.139905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.141913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.147465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.148090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.148371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.148643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.149317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.149649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.150091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 393/775] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.151084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.151365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.163070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 383/776] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.163754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.325392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.351289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ecdcc-dbc6-4a87-8ed2-1c5257400ecf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.376627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a3243-9a50-4730-a93b-c8a6d5fd499e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.395576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.397486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.398156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.398855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.399131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.399938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.400426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.401848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.408540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 384/777] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.409572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.446561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.447897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.448520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.449117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.452161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.452828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.455819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.490635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 394/778] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.492454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.542685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f4a3-4352-45bb-8474-eed7bf2c7fd3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.585578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.586346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.586630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.586903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.602859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.604550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.614598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:17.626010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:17.634684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:17.635614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:17.635614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:17.635614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:17.635614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 385/779] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:17.635614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.804564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494047b-62a7-4cda-b9fe-8aff2d135ce0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.819037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06e08e-c370-4aa0-a52c-d97e33d71230 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:17.853922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.854563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.854840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.855106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.855736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:17.856961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.858668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.864889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 395/780] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:17.866022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:17.895228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:17.896551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:17.897043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:17.898039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:17.905483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:17.917566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:17.922239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:17.953691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:17.955498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:17.957266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:17.959113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 386/781] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:17.959113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.001223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223af43-b244-49c2-bcf9-183c761bcef4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.048003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.052138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.066681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 396/782] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:18.067522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.080765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.164939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e65e-aa12-4bb0-bade-e60603730eda None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.181413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.193277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43efc70-7fb2-4cbc-93fc-3cf9edc12e22 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.232826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.233868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.234375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.234861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.235353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.236121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.236236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] RBAC: Adding query filter params (interface=public, service_id=5522e95f4a0347238864f0f1152518c9, region_id=RegionOne) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:18.236638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.236751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.237151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.238019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:18.238461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.239402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.240450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.265049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 387/784] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:17 2022] GET /identity/v3/endpoints?service_id=5522e95f4a0347238864f0f1152518c9&interface=public®ion_id=RegionOne => generated 194 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:18.266668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.267011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 397/784] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:18.273554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.401503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce429c9-5c62-482c-8383-5d336709425e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.405916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed9ea6-a617-4024-9e83-12ddb8adfbd2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.430347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.444461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.445582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.446115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.447156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.458328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.458577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.459047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.459322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.459573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.459820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.460282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.461557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.477935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 398/785] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/services => generated 772 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:18.477935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a2ad6b25-7467-4d29-ba00-f68697ee0cf4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:18.478342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:18.479653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:18.480661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 388/786] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:18.482951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea345-f4c9-4173-8fa6-23760e4847bd None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.482951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea345-f4c9-4173-8fa6-23760e4847bd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.482951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ea345-f4c9-4173-8fa6-23760e4847bd None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.487609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 389/787] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:18.488580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ea345-f4c9-4173-8fa6-23760e4847bd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.550334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:18.666776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7c8b-101c-46be-8f4a-ee2afaa77f0c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.678965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ea345-f4c9-4173-8fa6-23760e4847bd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:18.719332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.720123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.720407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.720681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.722937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=dd12e6654aad484d8edb0b82f86ba8ef, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.724440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.746237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:18.750612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.750612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.750612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.750612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:18.750612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:18.753209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087617-ded2-4535-b0eb-0ea394abb517 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:18.792168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 390/788] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:18.792168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:18.792168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:18.792482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:18.824074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:18.826323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:18.835815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 399/789] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:18 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:18.844189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:18.947338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.050877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 391/790] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:19.097841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.143715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da3ab1-2eb4-4c2e-be8c-cf045e169e6b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.213817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.214829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.215855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.216434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.240216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.243362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:19.288669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:19.289782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:19.290750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:19.290750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:19.290750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:19.298508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 400/791] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:19.298715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.399760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.559770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c100c8-5841-43fe-9fcd-9a6da4592516 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.661510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.663366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.664017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.666060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.667110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:19.667945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:19.670795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:19.692901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 392/792] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:19.702734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.734924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636949c3-5bd8-42fd-941e-a5c713dc5332 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:19.767199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.802720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:19.826774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:19.827344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:19.827620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:19.827890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:19.858955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:19.864269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:19.865510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:19.866405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:19.870907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 401/793] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:19.883723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:19.929101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e26f-0b22-4ee2-80a0-4e965a68275e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.002033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.002689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.002967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.003238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.021078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.022592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:20.045542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:20.047765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:20.049136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 393/794] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:20.056021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.135764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540f4e2-86c1-4138-9f56-4f93ca77692c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.204354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.205369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.205856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.206340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.207478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:20.207990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.210581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.227735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 402/795] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:20.251842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.371183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.387988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.410684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8aec5-d55b-4277-b727-6831f866b434 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.510662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313ccd4-e3fb-4a7a-978a-8f26dd177e8d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.515682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.516747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.517238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.517712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.519110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:20.521026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.525108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954850-fcd7-4090-9795-4b6abf8af748 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.604042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.605137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.605619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.607079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.630009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.632305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-5b905386-4672-4423-8c36-9060bc569ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:20.662746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:20.663773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:20.664686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:20.664686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:20.664686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:20.665383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 403/796] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:20.667762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f0d8-d91d-4915-bbde-a520280d30f9 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.668514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f0d8-d91d-4915-bbde-a520280d30f9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.668799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f0d8-d91d-4915-bbde-a520280d30f9 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.671484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 404/797] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:20.672786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44f0d8-d91d-4915-bbde-a520280d30f9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.685412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 394/798] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 630 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:20.686765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.687046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.687317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.707790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:20.709027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:20.807539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 395/799] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:20.808474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:20.835622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44f0d8-d91d-4915-bbde-a520280d30f9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:20.837448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:20.878935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:20.879846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:20.880284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:20.880714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:20.881513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:20.882025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:20.883571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:20.898522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 405/800] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:20.905407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.018651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.030307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862209-4750-4f9e-bec3-6071ac0fd26a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.044689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b327-24da-4dd5-ac72-b374b0ee727b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.086174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.086842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.087121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.087392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.096591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.098115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:21.111424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:21.113281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:21.115593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 406/801] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:21.121931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.123220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.124003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.124357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.124699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e5e97d95774e4618a71c8b864d29dc3a/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.150538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.186862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=e5e97d95774e4618a71c8b864d29dc3a, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.188375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.250502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afd4c-8ecd-46eb-83cd-ef209057c93e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.295366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.295910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.296194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.296469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.297231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:21.297541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.299083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b88e0-9ebc-4c2d-823b-d6040523353e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.317779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 396/802] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:20 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e5e97d95774e4618a71c8b864d29dc3a/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:21.319651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.326347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 407/803] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:21.326347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a8f8-de75-472d-8f18-e5197c593f38 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.326347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a8f8-de75-472d-8f18-e5197c593f38 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.326347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9a8f8-de75-472d-8f18-e5197c593f38 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.326347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 408/804] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:21.331002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9a8f8-de75-472d-8f18-e5197c593f38 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.432387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.457336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9a8f8-de75-472d-8f18-e5197c593f38 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.506799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa5307-d105-4e58-ad6e-880ebc6b170f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.536078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.538611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.539397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.540384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.544183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.551740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.552305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.552594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.552861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.553448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.554940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3734329b-101a-422e-b923-932fe59de1c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:21.566269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:21.570222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 20:01:21.571869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:21.574799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 397/805] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:21.574799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.574799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.575176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.577162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.582100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.598612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:21.599928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:21.618417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:21.620244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:21.622158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:21.622158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:21.622158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:21.622158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 409/806] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:21.622158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.743798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 398/807] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:21.745093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.805627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e72fa-4259-439a-8d4e-9c6ab76be45b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:21.873393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:21.883292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:21.890882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.890882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.890882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.890882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:21.890882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:21.892469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86dc4d4-2d1c-41fb-8172-1c307ab22288 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:21.902367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 410/808] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:21.905127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72960b-dcf9-4c9d-bf24-55bcc9d273bd None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:21.906037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72960b-dcf9-4c9d-bf24-55bcc9d273bd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:21.906955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72960b-dcf9-4c9d-bf24-55bcc9d273bd None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:21.910851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 411/809] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:21.912610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72960b-dcf9-4c9d-bf24-55bcc9d273bd None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:21.979329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657cac9-1be9-42fb-92a5-a4136f821bb7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.035487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.053657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.054395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.054683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.054929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.055589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.055951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.057280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a3ade-e685-4e2c-8618-e92219c5797b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.077240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 399/810] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.079292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.079748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.080131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.089552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72960b-dcf9-4c9d-bf24-55bcc9d273bd None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.110564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:22.112419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:22.150248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.151196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.151575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.152049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.153746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.154320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.156864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.170578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 412/811] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 17 20:01:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.170578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.245921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 400/812] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:22.245921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.302911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.361044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3ca2-dcbc-49fc-b7fe-3116f4a8d6e3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.406173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.406981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.407353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.407716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] PATH_INFO: `/v3/services/network` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.408437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.410490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:22.423079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:22.424146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:22.425012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 413/813] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:22.426494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.440420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d4770-50d7-4d27-9e13-360269560c30 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.470106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.497448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.498517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.499190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.499701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.508073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.510163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:22.524014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:22.524971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:22.525867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:22.529815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 401/814] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:22.531069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.582751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef82f-3d4f-475c-8766-fb34d86a5b3b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.614210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.629900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.630700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.631290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.631705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.632824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.634379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.651151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe5b34-1612-4bca-9a98-90fe69abdc57 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.692793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.693406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.693680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.693984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.694614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] RBAC: Adding query filter params (name=network) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.695115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.696548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.704911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 402/815] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.705508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.743048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 414/816] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:22.744711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.760848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:22.865631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ed155-cf4b-4297-a0e1-b7e0c25d8e61 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.918418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.919385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.919885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.920297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:22.920905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97092-0412-43dd-99cb-f62bf989c909 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:22.921694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:22.922208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:22.924137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:22.946230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 403/817] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:22.947996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:22.985893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:22.986952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:22.987267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:22.987531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.002440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:23.008717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:23.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 415/818] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:23.012984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.086878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.103855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.111476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f78cc1-723e-4b43-9bb1-359cde10f8bd None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.157853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.157853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.157853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.157853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.158933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] RBAC: Adding query filter params (type=network) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:23.159592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.162289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.171931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6162b7-23e1-4567-a30b-270b4d969c5c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.178071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 404/819] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:23.180327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.220236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.221409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.221695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.222003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/2598eac7e63d4e4385d2c7510fa16528/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.224031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=2598eac7e63d4e4385d2c7510fa16528, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.225524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.326017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 416/820] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:23 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/2598eac7e63d4e4385d2c7510fa16528/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:23.326017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.432827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2afd44-30af-4617-b6c4-2ee3fa91c353 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.546807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.548044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.548544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.549047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.550569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:23.551194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.553231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.565788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 405/821] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:23.573058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.611608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.638860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba10b-a38a-4918-adf6-5ebde12eb582 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.666540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.685648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.686769 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.687023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.687299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.687970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.693132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.751744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db19bb-fa36-4dcf-ac4f-5cb9fff2aff0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:23.792506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:23.794088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:23.794088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:23.794693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:23.807706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:23.809845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:23.827924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:23.828940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:23.830398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:23.830398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:23.830398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:23.830398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 406/822] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:23.835389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:23.848138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 417/823] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:23.936455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:23.973661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03742-a5ea-4ddf-89c2-a91e2b88d824 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.022939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.023582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.023861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.024132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.024862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:24.025165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.026637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.046247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 407/824] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:24.048627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.191732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093fde-4ec8-42f4-a378-4177ad6c1bfd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.247627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.248348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.248627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.248902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.265617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.267193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:24.281099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:24.282146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:24.283716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 418/825] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:24.289251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.420294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad27b-7a36-48d1-983f-104fa6c8b555 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.455239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:24.467414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.468256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.468755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.469208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.470143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:24.474076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.474076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42774ad0-697e-4efd-9cd0-2dc8b1afa144 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.511013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 408/826] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:24.520132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:24.555455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:24.638247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da463-482c-48ee-909a-882f11e8265c None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.638625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da463-482c-48ee-909a-882f11e8265c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.638884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da463-482c-48ee-909a-882f11e8265c None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.640271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 409/827] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:24.649212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.649691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.650217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.676442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491f375-eb5e-46e6-aa68-9c1e79077378 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:24.683258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:24.686028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:24.731516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:24.732528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:24.733012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:24.733576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:24.845345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 410/828] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:24.886609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:24.890469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:24.925552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.094633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 419/829] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:25.105843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.333539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.342854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf7b2f-b0be-4ffd-8367-428b7db09b80 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.386129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.437228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.438913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.439998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.440794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.468911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.472311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.488926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc94c5-fa7b-45d9-9968-5070eb960b8f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.512590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:25.514575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:25.516379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:25.518193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:25.518193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:25.518193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:25.518193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 411/830] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:25.529409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.554150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.555742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.556496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.557215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.578872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-0314bd32-59f5-475d-9654-53b5a1432719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:25.583725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:25.585679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 420/831] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:25.587206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dfea-57f9-4ede-bd4d-c2bd9cc4bcab None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.588655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dfea-57f9-4ede-bd4d-c2bd9cc4bcab None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.588655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7dfea-57f9-4ede-bd4d-c2bd9cc4bcab None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.588655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 421/832] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:25.593480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dfea-57f9-4ede-bd4d-c2bd9cc4bcab None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.682908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a76f1-65bc-4508-8b74-d7bce0405240 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.719930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7dfea-57f9-4ede-bd4d-c2bd9cc4bcab None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:25.738280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.738915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.739626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.739918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.740581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:25.740895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.742326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f74bd-fca2-4536-bb6c-e2493b7aa125 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.755931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 412/833] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:25.757218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.757504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.757779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.772776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:25.773798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:25.774249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:25.774668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:25.775483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:25.775945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:25.777450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:25.777823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:25.778736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:25.795089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 422/834] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:25.797448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.819554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.848733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:25.886924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 413/835] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:25.889364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:25.972728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f811a6-e450-49db-935c-020e47c79950 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.045853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.047340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.048085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.048812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.066391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.071349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.076012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812f495-b8aa-41f4-8628-a0f3e9ed2d66 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:26.097564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.099884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:26.101665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:26.112997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 423/836] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:26.117864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.168323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.170188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.171430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.173582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.189516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.191075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3b02aa00-4e53-41be-a0da-6964921eecbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:26.206556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.208417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 414/837] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a59-78cb-44d8-a645-8deb9595c10e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a59-78cb-44d8-a645-8deb9595c10e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.210194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006a59-78cb-44d8-a645-8deb9595c10e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.218295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 415/838] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:26.218295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06006a59-78cb-44d8-a645-8deb9595c10e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.229091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.288174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.292110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a407e-73e8-4395-83c9-311b70c06ccb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.330855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.331807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.332277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.332723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.333813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.334282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.335850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.349666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 424/839] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.350566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.381807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06006a59-78cb-44d8-a645-8deb9595c10e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.427694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.428336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.428614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.428887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.429488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.430933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-2af20c27-879b-4b8f-a083-945ae7364531 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:26.441358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:26.443347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:26.445011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 416/840] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:26.446546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.446546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.446546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.463610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:26.465397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:26.490596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb191-6062-4702-a3f6-e78cd6295d14 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.529461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223be10-6481-461d-bb41-789c99257680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.530128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223be10-6481-461d-bb41-789c99257680 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.530414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223be10-6481-461d-bb41-789c99257680 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.530690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223be10-6481-461d-bb41-789c99257680 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.532042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223be10-6481-461d-bb41-789c99257680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.532349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223be10-6481-461d-bb41-789c99257680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.533797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223be10-6481-461d-bb41-789c99257680 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.552678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 425/841] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.552678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223be10-6481-461d-bb41-789c99257680 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.568001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 417/842] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:26.568855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.572281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.574519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.681254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223be10-6481-461d-bb41-789c99257680 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.689995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5291d-6bef-44aa-b116-d41d84bf705a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.727124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.727955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.728336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.728740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.729601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.731005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.732290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.732724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.733115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.733500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.733897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:26.734701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:26.735109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:26.736694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:26.741518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 426/843] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.743112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 418/844] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:26.743478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.752655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:26.874350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.906883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:26.939643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b9a3-d675-405e-b039-645da3df4df1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.945375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb73cb0-657c-4674-bf87-711cb3d231be None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:26.997348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:26.998533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:26.998533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:26.998533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.000228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.000228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.000822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.002775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.003531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.003931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.004304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.007839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 419/845] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.008704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.014081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.015673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:27.031376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:27.032983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:27.035073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:27.039275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 427/846] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:27.046950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.212149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd042ab-d72f-4313-94ba-6b0602327dc0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.220698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2bb8-310b-4d8e-9bd0-42b84e0ddf3b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.293656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.294356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.294636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.294908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.295352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.295717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.296029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.297514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.306220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.310870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.310870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.310870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.320202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 428/847] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:27.320766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.331558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.338228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:27.344500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:27.347045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:27.348965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 420/848] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:27.351823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.501605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a6374-0573-4abf-b22c-c4b0c577ac65 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.516052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7819e0-c692-4f59-a556-f3aac4f484ec None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.572607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.574458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.575119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.575993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.577424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:27.578216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.580985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.582592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.583675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.584439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.585062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.599156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 421/849] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:27.605143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.669443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.705003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:27.707916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.709490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.735131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b6d79-517e-40a8-bce4-b61e35dc0ce2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.776481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:27.777564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:27.777838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:27.778142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:27.792369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:27.802688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:27.831040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:27.832181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:27.833277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:27.833277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:27.833277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:27.833563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 422/850] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:27.838920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.882097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 429/851] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:27.885008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:27.959967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53effa84-ad5e-42c5-96a3-865d5ef0e8e3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:27.970489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.005182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.006692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.007632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.009368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.009947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.010737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3a29a-2749-49c8-bcc7-878cbf025e5c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.011722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.012205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.015318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.035063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 423/852] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.041112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.061267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.062137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.062528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.062910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.077160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.078933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:28.097465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:28.098687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:28.099779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:28.099779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:28.099779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:28.106430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 430/853] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:28.107703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.193356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd5826-507f-432e-b862-7bb524bd469f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.231682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec709d-b5a1-4f5f-b984-9606eb2ddf30 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.234193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.235020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.235537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.236004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.248135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.250011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:28.267439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:28.268419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 20:01:28.269374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:28.275868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 424/854] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:28.278719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.279761 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.280417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.280698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.281018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.281699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.282063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.283467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.302048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 431/855] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:28.303595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.317100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.321666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.407053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30404-78d0-4798-951a-945c4b3f559b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.424860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22aa9e2-06f5-4628-8fac-38b799d5bc56 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.448792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.450505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.450720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.450967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.451706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.452080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.453558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.468100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.469101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.469620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.470130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.478445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.479897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 425/856] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.481203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.482185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:28.495164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:28.496372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:28.497303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:28.504657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 432/857] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:28.505972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.578730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.591230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.597152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15819861-532e-40e3-901b-0a3be57d1356 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.628061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a549aa64-741a-4249-b567-60d68f05e223 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.638700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c1055-a809-431c-862b-b86657613001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.639165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1055-a809-431c-862b-b86657613001 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.639444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1055-a809-431c-862b-b86657613001 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.639709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c1055-a809-431c-862b-b86657613001 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.672294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.673286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.673773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.674335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.675358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.675974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.677775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.699905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 433/858] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.701203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.720106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c1055-a809-431c-862b-b86657613001 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.721680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c1055-a809-431c-862b-b86657613001 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.817986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.823175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33699d2-4adc-45a5-8f07-aaf308a7c66b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:28.842790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 426/859] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:28.844343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c1055-a809-431c-862b-b86657613001 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:28.858252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:28.864273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:28.865187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:28.865652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:28.866141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:28.867217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e5e97d95774e4618a71c8b864d29dc3a) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:28.867748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:28.869397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:28.882193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 434/860] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/role_assignments?user.id=e5e97d95774e4618a71c8b864d29dc3a&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:28.974201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c1055-a809-431c-862b-b86657613001 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.018555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.019204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.019498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.019926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.033242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.034773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-146980f0-48d0-4126-a6b2-78d38dbce28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:29.053293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:29.055145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:29.056776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:29.056776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:29.056776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:29.061916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 427/861] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:29.062274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.255623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f86123-9fed-47b1-9e3e-bab40951fe82 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.255814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2def9-8d4f-49b8-8327-2e81e238246e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.256324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f86123-9fed-47b1-9e3e-bab40951fe82 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.256324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f86123-9fed-47b1-9e3e-bab40951fe82 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.258044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 428/862] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:29.268618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.269198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.269686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.290428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:29.292138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:29.309303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.310453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.310729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.310994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.311990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:29.312297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.314020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.329287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:29.334621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 435/863] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:29.342797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.390547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 429/864] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:29.433201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:29.506549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f3f5a-9d1d-4403-a8fd-a33948fca10f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.546747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.547768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.548266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.548732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.556917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.559744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3deb64a4-20bd-470c-88f3-5150c3263c40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:29.573277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:29.575242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:29.576146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:29.583446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 436/865] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:29.585154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.701995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231564b-f4c4-4c2a-a91d-68ef934ca27c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.702230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231564b-f4c4-4c2a-a91d-68ef934ca27c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.702575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231564b-f4c4-4c2a-a91d-68ef934ca27c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.711996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 437/866] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:29.714939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.715414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.715902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.719765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00487903-a333-4cb3-8d69-15724db2eb42 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:29.748600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:29.750751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:29.769667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:29.770710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:29.771191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:29.772082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:29.773151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:29.773765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:29.775459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:29.798227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 430/867] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:29.801379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.851645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:29.865941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 438/868] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:29.897547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:29.995035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058f087-b3ee-4c6f-bdc5-e9f08a4ef6e4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.001297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:30.067334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.068935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.069701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.070531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.072383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=2598eac7e63d4e4385d2c7510fa16528) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:30.073379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.077090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.082073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ede508-d2c6-4029-8bc5-4a991b0cb357 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.090017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 431/869] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:29 2022] GET /identity/v3/role_assignments?user.id=2598eac7e63d4e4385d2c7510fa16528&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:30.129324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.130088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.130395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.130664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.131293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.132686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.281614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 439/870] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:29 2022] POST /identity/v3/services => generated 251 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:30.287652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:30.405000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:30.416937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b019fb9-357a-43b6-b53c-3238663cc7f9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.469932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.471053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.471560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.474804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.474804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.478310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:30.496617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:30.498966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:30.502184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 432/871] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:30.503747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:30.654579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45346fa3-c200-4402-a48e-1abb5d5de343 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.663796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:30.700044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.700671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.700947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.701212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.701867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:30.702203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.703614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110807d-221b-452b-a717-94eb16e83997 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.715508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:30.726501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 440/872] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:30.854404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29b78d-0193-46b9-bfdf-72ca90c2ec32 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:30.923919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:30.924868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:30.925360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:30.925834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:30.927024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:30.927568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:30.930263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca22eb5-90cb-4602-8cb8-feba3e7f1137 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:30.941378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 433/873] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:31.595253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77383d-ca87-4123-b5a9-264e6f6e6edc None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.596027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77383d-ca87-4123-b5a9-264e6f6e6edc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.596486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77383d-ca87-4123-b5a9-264e6f6e6edc None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.599617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 441/874] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:31.608603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:31.609573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:31.609573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:31.643685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:31.645924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:31.666809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:31.802125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 434/875] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:32.308048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77383d-ca87-4123-b5a9-264e6f6e6edc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.525526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77383d-ca87-4123-b5a9-264e6f6e6edc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.592227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.593403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.594000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.594492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.616772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:32.626991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:32.628114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:32.629035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:32.634129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 442/876] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:32.640096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.771649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2926dc-2e08-4e36-8372-3bf0bdc15177 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:32.812087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:32.812617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:32.812902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:32.813166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:32.813856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:32.814200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:32.815601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:32.825367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 435/877] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:32.830929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:32.869204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:32.976716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443725c9-c702-4105-a7b1-56033a0f22b8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.016275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.017203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.017644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.018102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.031606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.033353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a6b0e90f-bb70-48f2-b693-5eae3e83d34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:33.049858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:33.061599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:33.062835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:33.062835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:33.062835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:33.062835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 443/878] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:33.063147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.069034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa30f-a25b-49c4-8f36-c9ec9ee1a208 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.069569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa30f-a25b-49c4-8f36-c9ec9ee1a208 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.070041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424fa30f-a25b-49c4-8f36-c9ec9ee1a208 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.070703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.072788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 444/879] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:33.078844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e2a9-c587-4901-a60e-f2c1d52604a9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.079349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e2a9-c587-4901-a60e-f2c1d52604a9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.080822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e2a9-c587-4901-a60e-f2c1d52604a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.103036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-dae8e2a9-c587-4901-a60e-f2c1d52604a9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:33.105400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-dae8e2a9-c587-4901-a60e-f2c1d52604a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:33.188427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 445/880] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:33.194204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fddf5-809a-49bd-b6a8-c54da9c45bfb None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.194204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fddf5-809a-49bd-b6a8-c54da9c45bfb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.194204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fddf5-809a-49bd-b6a8-c54da9c45bfb None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.194204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 446/881] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:33.199717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.199983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.200288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.211730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d310d-f53e-4e4f-a220-6d90889015d3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.230175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:33.232433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:33.246673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.264530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.265729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.265729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.265729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.266423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:33.266726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.268156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.288688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 436/882] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:33.290063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.383555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.390777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 447/883] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:33.442137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c02062-86b6-4c8c-aadc-a0255e746e2c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.486480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.490967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.491704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.492229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.492530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.502667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.504180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-e742301f-cd76-49fd-b0eb-2addc3142716 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:33.517555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:33.518729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:33.519703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 437/884] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:33.520329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f29f-87eb-40f2-a4eb-403991d116f1 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.520709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f29f-87eb-40f2-a4eb-403991d116f1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.520709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862f29f-87eb-40f2-a4eb-403991d116f1 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.522211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 438/885] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:33.530264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862f29f-87eb-40f2-a4eb-403991d116f1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.624977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541d0b-3eb9-4ff4-851f-99789e714ff3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.647818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862f29f-87eb-40f2-a4eb-403991d116f1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:33.675158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.675783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.676093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.676320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.676986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.678523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.689266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.701207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:33.701964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.702311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.702626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.703451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:33.703802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:33.705583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ebf68-2e5a-4df8-99f6-0bae7b5bcdfd None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:33.727373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 439/886] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:33.730083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:33.730572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:33.731069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:33.754714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:33.756064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:33.779008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 448/887] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/services => generated 269 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:33.780704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:33.785131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:33.890474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 440/888] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:33.891833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.002260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b7764-5bb0-42cf-aac8-bd5348c0ff1b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.048168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.049677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.049677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.049677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.050178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.051601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:34.062093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:34.064151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.065760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 449/889] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:34.069791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.099290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9528f-b100-4470-b899-4a293980b7bf None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.119812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.149337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.150129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.150465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.150801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.193116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.246219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.248019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.250574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1b43a-bb21-43c4-b572-a3d4f544be45 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.305789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.306895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.307411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.307900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.308976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:34.309359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.311170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.316626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 450/890] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:34.317491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.417617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 441/891] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:34.419708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.447582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.462317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48304de-c564-4075-9490-a697d9d387a4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.520410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.533246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.534782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.535246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.535801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.536868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.539431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:34.558599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:34.559788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:34.560634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.561392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 451/892] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:34.562507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.575685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc6e8a-22ce-4d15-8cfd-cba28ce45f33 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.641233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.642287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.642775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.643248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.644391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:34.644919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.647508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.656718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 442/893] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:34.658583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.739832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77d4bf-beef-4fae-9b5c-12d6956e786c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.811293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.812245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.812748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.813190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.836788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.839265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.843809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:34.868983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:34.871541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:34.873226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:34.873226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:34.873226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:34.876080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 452/894] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:34.889241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:34.897700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959ae4-909e-488e-847e-c84a01c104f5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:34.971792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:34.973342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:34.974012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:34.974713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:34.976254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:34.977062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:34.980859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:34.982638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:34.992807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 443/895] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.002953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.079274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dd982-331c-474b-9574-821cc22ca365 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.145796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.146911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.147329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.147743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.148834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.149281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.153932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.178256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 453/896] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:35.184604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.205032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcb50d-35f0-404f-a55e-be490c106da8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.257664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.258322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.260768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.261618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.263180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.265698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.267889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.286054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 444/897] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.289375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.295249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.347772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e0758-34f1-4cc2-a845-a222e8c56a7d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.356777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.389509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.390565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.391072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.391557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.404494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.406021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:35.418555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:35.419558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:35.420472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:35.424888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 454/898] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:35.426239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.429545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df911726-bb3b-4775-a155-a6b5ec442890 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.488783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.490472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.491216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.492201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.494310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] RBAC: Adding query filter params (interface=public, service_id=69bfcfee05d94cb89639db40ff0c0b9f, region_id=RegionOne) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.495149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.498596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.510382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 445/899] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/endpoints?service_id=69bfcfee05d94cb89639db40ff0c0b9f&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.517005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.574423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994cb2-7ea8-4fec-864f-64170a4f5b46 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.592792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.646339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.646849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.647120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.647392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.648098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.648406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.649859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.657457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fef-cdae-4cb8-aa14-bb7899e6ac5f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.673913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 455/900] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:35.678409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:35.717212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.717895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.718316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.718697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.719424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.722132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee96cd5-0e2f-49f2-a402-08ec989ea4d4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.737932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 446/901] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/services => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:35.747978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:35.872012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eec5a5-f1b2-4481-9282-888a989f1f89 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:35.941107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:35.942591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:35.943044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:35.943534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:35.944768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] RBAC: Adding query filter params (role.id=85d07b40a7e347a994d771c7ea733c82, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e5e97d95774e4618a71c8b864d29dc3a) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:35.945268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:35.947914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b1849-acca-4fe0-95ff-7fb0245e453e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:35.965997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 456/902] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:35 2022] GET /identity/v3/role_assignments?user.id=e5e97d95774e4618a71c8b864d29dc3a&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=85d07b40a7e347a994d771c7ea733c82 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:36.089650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889fea-4433-494a-8863-4cdc68e89f59 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.090043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889fea-4433-494a-8863-4cdc68e89f59 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.090449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37889fea-4433-494a-8863-4cdc68e89f59 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.092243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 447/903] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:36.099116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.099576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.100039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.127976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:36.129592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:36.208257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 457/904] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:36.475515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37889fea-4433-494a-8863-4cdc68e89f59 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:36.660971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37889fea-4433-494a-8863-4cdc68e89f59 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:36.718426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:36.723256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:36.723924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.724205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.724483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.725088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:36.726588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:36.736964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:36.748934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:36.749839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 448/905] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:36.750678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:36.786986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:36.881966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326ab6f-9e3e-4779-8075-2333df77e871 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:36.920209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:36.920885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:36.921170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:36.921442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:36.922115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:36.922420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:36.923814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:36.929509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 458/906] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:36.936519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.055798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8941-8144-4907-be8f-321d616f39ec None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.094157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.095125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.095593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.096123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.096974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:37.097470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.099101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.110039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 449/907] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:37.112221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.210954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.230278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac5a28-f29e-4675-8aeb-6fc8077c3236 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.270602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.271225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.271502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.271772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.272555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] RBAC: Adding query filter params (interface=public, service_id=aaca5447872848d484b4fd5e693bd96c, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:37.272882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.274324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdbdff-4a98-48cc-84bc-62a2b0041eff None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.281512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 459/908] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/endpoints?service_id=aaca5447872848d484b4fd5e693bd96c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:37.287152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.358259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.368723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715289-399b-4b9f-89a8-97bc9f05872c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.369017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715289-399b-4b9f-89a8-97bc9f05872c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.369278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715289-399b-4b9f-89a8-97bc9f05872c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.371187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 460/909] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:37.377118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cec8-3ef1-4333-8a00-73d537c0db39 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.377397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cec8-3ef1-4333-8a00-73d537c0db39 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.377715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8cec8-3ef1-4333-8a00-73d537c0db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.399545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c9c8cec8-3ef1-4333-8a00-73d537c0db39 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:37.401060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c9c8cec8-3ef1-4333-8a00-73d537c0db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:37.407075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14264782-8cfc-4013-99e7-57939bfc10e3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.446932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.447633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.447981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.448265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.448872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.450329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:37.457132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 450/910] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:37 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:37.484489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 461/911] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:37.763310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:37.882183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e2dd-5954-4609-b4d9-7df8ae9bcda3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:37.895736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366b4b-e71f-4c6b-9f92-d32068e64334 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.896759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366b4b-e71f-4c6b-9f92-d32068e64334 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.897254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366b4b-e71f-4c6b-9f92-d32068e64334 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.899270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 462/912] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:37.905182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.905783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.906309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.913415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:37.926684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:37.928318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:37.937580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:37.937580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:37.937580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:37.937580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:37.937966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:37.937966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.014469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 463/913] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:38.020023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 451/914] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:37 2022] POST /identity/v3/services => generated 241 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:38.300593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.313618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:38.420095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb1cf3-de04-4bf0-8894-739d3f6273b0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:38.465218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:38.466147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.466596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.467029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.467767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:38.469318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:38.479338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:38.480621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 20:01:38.481659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:38.489918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 464/915] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:38.490359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.606904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd397bd-aaf9-4cb5-a077-957f532bfced None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:38.648101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:38.649238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.649778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.650284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.651193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:38.651824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:38.654105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9230d4-93a0-4e40-ab90-3da6749b99de None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.660606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 452/916] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:38.665996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.754529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:38.796902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c6a38-0e91-4fce-8aa8-197d8019019c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:38.818309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87febca-9d02-40b2-88c1-d740c917b719 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.819297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87febca-9d02-40b2-88c1-d740c917b719 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.819778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87febca-9d02-40b2-88c1-d740c917b719 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.823093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 453/917] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:38.828832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.829425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.829983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.839150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:38.840039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:38.840599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:38.840880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:38.841520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:38.841819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:38.843221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:38.848942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 465/918] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 17 20:01:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:38.852484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:38.854192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:38.854628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:38.923120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:38.963645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 454/919] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:39.011753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b37bb1-bdd9-4753-b0d6-301019aa52a4 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.053319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:39.060019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.060967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.061431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.061859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.062745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.064310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.158832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 466/920] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:39.294547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.445190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c837b0e-92df-4b26-9fb3-f5bb1bf11d12 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.502176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.503283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.503775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.504220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.519082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:39.525320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:39.527032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:39.528012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 455/921] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:39.534722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.671145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c8c8a-e11c-44f3-b5e8-80313bbca889 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.712586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.714235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.714719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.715203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.716115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:39.716626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.718294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d12250-f412-4137-99f9-d9d2e7413946 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.729209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 467/922] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:39.735365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.776073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:39.862047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc7c4-eaac-49c2-84d2-2206cf1f7d92 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:39.910899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:39.911606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.911889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.912165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.925189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:39.926860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:39.926992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7749d-1b48-4c60-9734-40a7fd0c9cac None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.927430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7749d-1b48-4c60-9734-40a7fd0c9cac None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.928127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7749d-1b48-4c60-9734-40a7fd0c9cac None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.938329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 468/923] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:39.940884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:39.941578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:39.942282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:39.943309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:39.945031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:39.946820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:39.946820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:39.946820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:39.946820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 456/924] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:39.950954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:39.980756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:39.983210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:40.055568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:40.085510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb070f-5a5f-40bb-87ed-98f3c90215e3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.090567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:40.129214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 469/925] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:40.155819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:40.156856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.157346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.157836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.158733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:40.159262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:40.160912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:40.177600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 457/926] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:40.185213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.307786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e262f-4a5b-4f3b-b29e-b6514c5963a6 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.345295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:40.345949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.346220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.346489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.355078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:40.356530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-74688aec-6e5e-4166-9347-af3d9de9fb3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:40.369779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:40.371611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:40.373550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 470/927] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:40.388005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.516202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974164-23fb-47ea-8755-f9c3b8fb9ddf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.555500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:40.556117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.556419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.557220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.558051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:40.558447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:40.559980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:40.567141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f11f-e9cf-4323-9019-1c778c6c6545 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.567768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f11f-e9cf-4323-9019-1c778c6c6545 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.568272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f11f-e9cf-4323-9019-1c778c6c6545 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.574033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 471/928] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:40.577550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.578234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.578712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.582387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 458/929] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:40.590933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.599958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:40.601682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:40.610393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:40.651220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:40.691488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 472/930] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:40.692134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.722726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034af42-8a89-41e8-8468-fc1c185fd571 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.764030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:40.765084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.765595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.766119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.778660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:40.780546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:40.797999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:40.799030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:40.799927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:40.799927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:40.799927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:40.802179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 459/931] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:40.809189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea3399-bb0f-4cfb-8608-95a3f46d63e7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.811241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.871579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:40.873160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:40.874017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:40.874803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:40.876172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:40.879175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:40.886594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:40.899063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:40.901844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 20:01:40.903703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:40.914389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 473/932] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:40.919968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:40.949097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738a7a-09ae-4901-8218-f33e33e83915 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:40.977772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.017110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.018910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.019379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.019997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.021180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.021751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.024431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.049312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 460/933] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:41.051177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.070047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5dca2-497c-42fe-a491-728627d193c9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.127123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.128175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.128175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.128429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.128941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.129240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.130679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.138065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 474/934] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:41.139030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.236204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fcd77-27b8-448c-a674-750746cfa75c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.262319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.290093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.290974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.291765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.292266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.292763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.293849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.295998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.296498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a73cca-6ee0-4ba6-bd72-0a7446da0121 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:41.308007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:41.310085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:41.312051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:41.313613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 461/935] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:41.314792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.356679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.357637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.358168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.358647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.370799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.373545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:41.394180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:41.395266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:41.396165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 475/936] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:41.397539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.430559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea6c17-6cbf-479b-b942-f16ac9c361b2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.478059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.479227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.479735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.480232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.481440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.482021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.484593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfdc6-8358-4f18-ac51-848533a4dda5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.491886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 462/937] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:41.494693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0f5c-024d-4ed7-ba10-dd9850f974e8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.495361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0f5c-024d-4ed7-ba10-dd9850f974e8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.496071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa0f5c-024d-4ed7-ba10-dd9850f974e8 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.498835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 463/938] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:41.503194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0f5c-024d-4ed7-ba10-dd9850f974e8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.523722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e914a-701e-40e3-956e-56b6d9fb9f6c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.557632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.562748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.563646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.564010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.564383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.565177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.565567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.567362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.573812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 476/939] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:41.574487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.601673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.625787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa0f5c-024d-4ed7-ba10-dd9850f974e8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.666909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.667683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.667977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.668242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.668945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:41.669247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.670736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8a978-e049-45f2-95a7-59f45d06de58 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.684099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 464/940] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:41.685361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.685646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.685945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.705210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:41.706489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:41.710547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcd802-c1ca-4fcd-8a8b-29b41992e254 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:41.749567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:41.750349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:41.750691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:41.751238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:41.752487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:41.754790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:41.791907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 465/941] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:41.792972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.835170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:41.839715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 477/942] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:41.841445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:41.954425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db09c70-ec15-47cc-aa58-28b22d749178 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.009507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.029226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.030056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.030456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.030826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.032223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:42.032643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.034190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.045963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 466/943] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:42.051867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.058768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fe141-aed7-40a1-9d95-25eb4cafb925 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.107539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.108214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.108497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.108763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e5e97d95774e4618a71c8b864d29dc3a/roles/85d07b40a7e347a994d771c7ea733c82` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.110986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=e5e97d95774e4618a71c8b864d29dc3a, role_id=85d07b40a7e347a994d771c7ea733c82)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.112527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.180327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.189972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0838ca-c85f-4ebb-8fd8-1f1e25ba8e12 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.232573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 478/944] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:01:41 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/e5e97d95774e4618a71c8b864d29dc3a/roles/85d07b40a7e347a994d771c7ea733c82 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:01:42.234310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.249215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.250990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.251496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.251991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.253592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] RBAC: Adding query filter params (interface=public, service_id=ae4a7e15733044ca8ec431289cbf5116, region_id=RegionOne) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:42.254728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.260792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.276400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 467/945] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/endpoints?service_id=ae4a7e15733044ca8ec431289cbf5116&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:42.278405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.453635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f447-0be6-4020-9014-17f5aa1e1b7e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.461952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb0a7-2a45-41b5-b46f-2d619561087f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.504193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.505148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.505649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.506150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.506972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.508581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.516329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 468/946] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/services => generated 1497 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:42.523082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.524172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.524679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.525252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.527040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.529997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.535039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING keystone.server.flask.common [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 20:01:42.549253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.615791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.sql.core [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:42.615791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 20:01:42.615791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [parameters: {'id': 'fa385ede55994b44972af1127517a98d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 20:01:42.615791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81921) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa385ede55994b44972af1127517a98d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa385ede55994b44972af1127517a98d. Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:42.625469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 20:01:42.627249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application yield resource Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise self.value Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application session.commit() Aug 17 20:01:42.628213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:01:42.629124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:01:42.630904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:42.632725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [parameters: {'id': 'fa385ede55994b44972af1127517a98d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.636811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:42.638758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa385ede55994b44972af1127517a98d. Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:42.640844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 479/947] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Aug 17 20:01:42 2022] POST /identity/v3/projects => generated 262 bytes in 394 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:42.647947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:42.674988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:42.771389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2028e8-f5be-40f0-b82f-dc2042ab2d11 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:42.811626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:42.812366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:42.812651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:42.812928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:42.823132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:42.824917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7a9fd87d-3418-42cc-92c0-b2294e9fddb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:42.839346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:42.840311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:42.841231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:42.842298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 469/948] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:42.849465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:43.044295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee138cb-883a-4581-9073-a74a4222cea2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:43.090744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:43.091399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:43.091722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:43.092004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:43.092868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:43.093214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:43.095401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea5059-08b8-4f91-b1f5-bc00d9112cf1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:43.121524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 480/949] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:44.401003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01017-e5a7-44bf-a32e-3e4c8646de38 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.401582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01017-e5a7-44bf-a32e-3e4c8646de38 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.401582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01017-e5a7-44bf-a32e-3e4c8646de38 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.403098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 470/950] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:44.408992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f6ed-ed13-447a-8f11-d9532a6c8319 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.409489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f6ed-ed13-447a-8f11-d9532a6c8319 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.409569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f6ed-ed13-447a-8f11-d9532a6c8319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.430537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-efe5f6ed-ed13-447a-8f11-d9532a6c8319 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:44.433079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-efe5f6ed-ed13-447a-8f11-d9532a6c8319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:44.491319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:44.512118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 481/951] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:44.629626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7040d70-1972-4f4b-aa39-05600734ac80 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.629962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7040d70-1972-4f4b-aa39-05600734ac80 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.630340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7040d70-1972-4f4b-aa39-05600734ac80 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.631998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 471/952] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:44.641842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.642827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.643625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.676345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:44.678871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:44.794057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 482/953] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:44.800186 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7040d70-1972-4f4b-aa39-05600734ac80 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:44.903277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:44.917696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7040d70-1972-4f4b-aa39-05600734ac80 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:44.957275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:44.958061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:44.958344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:44.958595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:44.959182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:44.960559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ed0782ca-71cd-44c6-b831-7dacaeadbdc5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:44.971343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:44.973376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:44.975134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 472/954] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:44.981930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.099137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33a3f-c651-435f-b03a-71fc07269a2f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.126429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.135674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a34d9-12ec-40a8-9e07-43ff263eea4e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.136061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a34d9-12ec-40a8-9e07-43ff263eea4e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.136602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a34d9-12ec-40a8-9e07-43ff263eea4e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.138729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 473/955] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:45.142980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.146702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.146702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.146702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.146702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.146702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.147972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03619f2-3406-42a8-8b54-b553d6161d16 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.148218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.148459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03619f2-3406-42a8-8b54-b553d6161d16 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.148459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03619f2-3406-42a8-8b54-b553d6161d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.154017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 483/956] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.160555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.178087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b03619f2-3406-42a8-8b54-b553d6161d16 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:45.179347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b03619f2-3406-42a8-8b54-b553d6161d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:45.282487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 474/957] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:45.283724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac117-8168-479f-b116-015801320f2d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.284015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac117-8168-479f-b116-015801320f2d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.284284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac117-8168-479f-b116-015801320f2d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.285587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 475/958] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:45.295367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.296136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.296634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.319514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:45.321337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:45.324218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41581f-aa36-428c-ba35-1db224a8240f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.368134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.368779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.369821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.370215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.370872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.371183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.372534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.377783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 484/959] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.378829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.443381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.475839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 476/960] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:45.529047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb13e21-2d2f-4cfd-b721-034b56555edf None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.555988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.560103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.595124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.596035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.596525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.596994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.620621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:45.630542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:45.631744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:45.632715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 485/961] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:45.640002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.683361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1168cd-3ee3-45be-a8df-97a1fec77e08 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.724382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.725069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.725355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.725732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.726402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.727906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:45.738205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:45.739290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:45.740167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 477/962] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:45.747781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.793925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4eeb-f9c7-42b1-b371-b0739098b0aa None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.794666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.826212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:45.845634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.846884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.847171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.847545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.848520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.848966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.851282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.870315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24c66-6d23-4f10-a41a-c14b6800a3c2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:45.870602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 486/963] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.874728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:45.920169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:45.920820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:45.921093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:45.921382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:45.922075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:45.922361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:45.924626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:45.932494 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 478/964] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:45.937859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.025382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a972021-40c8-4b34-a8e6-dd666b0befce None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.075409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.075977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.076257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.076526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.089788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.092061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.096795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094915-c326-417f-b631-e05aa30332c9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:46.108223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:46.110165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:46.112028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:46.112028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:46.112028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.112028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 487/965] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:46.112028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.142827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.151499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.157533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.158185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.158461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.158759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.159783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:46.159783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.161305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.168103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 479/966] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:46.168758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.262033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982b734-a070-48fa-9209-8003e6c03796 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.297517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f703f-68c9-4ce2-acaf-fb6d3d9f512b None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.302862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.303486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.303764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.304033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.304710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.306970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.336395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.337008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.337405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.337680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.338482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:46.338789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.340178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.358344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 480/967] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:46.358344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.360655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.sql.core [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:46.360655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 20:01:46.360655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [parameters: {'user_id': '3dee7054b6bd459ba78ee124b37d9a45', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 20:01:46.360655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81921) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:46.371281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:46.373084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application yield resource Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application next(self.gen) Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise self.value Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application session.commit() Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 20:01:46.376160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.session.flush() Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application compat.raise_( Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 20:01:46.378552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 20:01:46.385309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application conn.query(q) Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application result.read() Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 20:01:46.387791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [parameters: {'user_id': '3dee7054b6bd459ba78ee124b37d9a45', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:46.390332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 20:01:46.394704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 488/968] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 17 20:01:46 2022] POST /identity/v3/users => generated 160 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:46.401569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.442829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.488072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.501253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe25191-26d0-46c6-81af-bb3b1ee20e4f None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.513502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067287-c95f-4a12-9eac-8b9d57bf24ff None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.553079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.554788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.555672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.556976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.559073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.561538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.565320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.566374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.566840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.567300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.580834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.583513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:46.597426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:46.602278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 489/969] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:01:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:46.604458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.686784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 481/970] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:46.686784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.809897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eb499-61d2-406c-b133-d0ba1cfe73ac None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.873740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.874536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.874902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.875290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.877550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e28c5-0478-4028-b586-921a172b96c9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:46.878007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.887741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.895527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:46.905515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:46.910271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:46.911431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:46.912553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 490/971] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:01:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:46.922386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:46.949852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:46.951019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:46.951657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:46.952275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:46.953766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:46.954881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:46.957382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.001420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 482/972] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 17 20:01:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:47.004504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.055174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f3c1-def1-4cbd-88d0-e668b0f4ac50 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.104888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.106213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.106826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.107402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.108796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:47.109410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.112008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.159582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d25cb-b0f3-4a22-9714-85be6e9a5803 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.184592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 491/973] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 17 20:01:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:47.199682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.200465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.200678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.200967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.255548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.307902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.310485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969632e1-bc8d-4a6b-b787-1eff989b0931 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.435654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 483/974] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:01:47.441340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.507164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.530504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced73-a77f-4489-adf4-490734a7c7d3 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.531072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced73-a77f-4489-adf4-490734a7c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.531444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ced73-a77f-4489-adf4-490734a7c7d3 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.533658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 484/975] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:47.538921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.539294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.539546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.564880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19860df8-7f39-4fd1-bc84-b05a42eea84d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.575005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:47.577443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:47.607450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.608545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.608891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.609168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.625438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.626947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:47.649223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:47.650801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:47.651921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:47.651921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:47.651921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:47.654201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 492/976] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:47.660392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.689869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.694950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 485/977] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:47.841360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976b93-f30f-4b82-bcc7-606b7b893692 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:47.846130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:47.890732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:47.891452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:47.891800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:47.892144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:47.892947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:47.893324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:47.894833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:47.908714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 493/978] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:47.914972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:47.994583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.042766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993aab0-3a4e-4b84-bf75-d2a1a3150cd4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.086398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.087265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.087652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.087998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.097591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.099171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:01:48.112795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:48.114161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:48.115500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 486/979] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:48.125514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.145555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717c57-e959-4575-a4f1-8c729d38007b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.196097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:48.213962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.215018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.215382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.215748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.216903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.219547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.242944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f382e-2c0e-4e83-b44c-5e0b8d7e8f24 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.285288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.286105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.286391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.286662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.287352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:48.287653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.289137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f68a8-d4da-4382-ad6e-775532a2d70c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.298241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 494/980] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:47 2022] POST /identity/v3/services => generated 242 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:48.308573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 487/981] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:48.315463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:48.349977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:48.490340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0441bd-b660-426f-9259-fc09750170b2 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:48.533035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:48.533035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.533035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.533035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.534059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] RBAC: Adding query filter params (role.id=85d07b40a7e347a994d771c7ea733c82, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=e5e97d95774e4618a71c8b864d29dc3a) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:48.534059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:48.535383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255bb35-99c6-4503-bab3-b220753099ac None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:48.543906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 495/982] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:01:48 2022] GET /identity/v3/role_assignments?user.id=e5e97d95774e4618a71c8b864d29dc3a&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=85d07b40a7e347a994d771c7ea733c82 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:48.809378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a24e-05e5-4c6f-bb19-00dd8328f10a None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.809950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a24e-05e5-4c6f-bb19-00dd8328f10a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.810084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a24e-05e5-4c6f-bb19-00dd8328f10a None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.811603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 488/983] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:48.817582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:48.817866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:48.818217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:48.838007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:48.839612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:48.914633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 496/984] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:49.185195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a24e-05e5-4c6f-bb19-00dd8328f10a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.314320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a24e-05e5-4c6f-bb19-00dd8328f10a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:49.340608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:49.357024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:49.358774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.358774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.358774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.358994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:49.360290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:49.369814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:49.370999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:49.375224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 489/985] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:49.378267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.395088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:49.505239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90a975-ca10-4835-9d8f-99ccddbfd41e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:49.552034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:49.552898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.552898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.553166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.553929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:49.554352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:49.556398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:49.562932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 497/986] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:49.569966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.733285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc970-3ad2-446c-b7e3-5c05a26fb5be None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:49.775384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:49.776309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:49.776772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:49.777249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:49.778099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:49.778589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:49.780149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:49.786357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 490/987] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:49.796692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:49.938831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:49.974494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900b62-6362-4b51-8f3e-c3b2d465cd92 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:50.037552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:50.038695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.038974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.039444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.041558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] RBAC: Adding query filter params (interface=admin, service_id=ae4a7e15733044ca8ec431289cbf5116, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:50.042124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:50.044638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d41439-53bf-4fba-8f9e-32c4110d0795 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:50.058239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 498/988] 10.222.0.48 () {56 vars in 1249 bytes} [Wed Aug 17 20:01:49 2022] GET /identity/v3/endpoints?service_id=ae4a7e15733044ca8ec431289cbf5116&interface=admin®ion_id=RegionOne => generated 193 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:50.061048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:50.121402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:50.181750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45390f5c-31bd-4172-bb7c-e9d27ca60e92 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:50.221806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:50.222504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.222771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.223044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.223738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:50.225118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21120d-9118-4050-8116-4a941a3d28fc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:50.234405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 491/989] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:50 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:50.661842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749af5b1-69cb-4606-ab0e-3648e790fcd8 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.662661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749af5b1-69cb-4606-ab0e-3648e790fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.662661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749af5b1-69cb-4606-ab0e-3648e790fcd8 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.663976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 499/990] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:50.669728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.670054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.670338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.689376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:50.690632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:50.732591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80dd5-1d55-4302-b73a-414a63392262 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.732996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80dd5-1d55-4302-b73a-414a63392262 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.733449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe80dd5-1d55-4302-b73a-414a63392262 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.735965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 500/991] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:50.744130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:50.744632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:50.745128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:50.771639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:50.773747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:50.786818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 492/992] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:50.876640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 501/993] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:51.092357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.161683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.249549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c65ba2-c4db-4081-a403-45b221dfd40a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.295700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.296449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.296902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.297184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.298057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.299726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:51.310951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:51.312960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.315119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 493/994] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:51.318109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.324703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.422199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.460513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66e94a-8da8-4a8c-9f5c-4f82d3349839 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.489459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746cee7-9a57-4351-90db-89aaf6e181fc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.503036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.506237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.507278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.507781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.507941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.509327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.509637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.511459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.522371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 502/995] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:51.524719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.552418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.553136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.553502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.553917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] PATH_INFO: `/v3/services/image` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.554544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.556839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:51.572789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:51.573926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:51.574852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:51.578317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 494/996] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services/image => generated 86 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:51.584227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.659225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6cbf-ed95-41a2-ab55-87038fd29d03 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.707352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.707992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.708121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.708464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.709019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.709284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.710694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.714097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.718327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 503/997] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:51.729453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.750511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ddc-778c-4440-abb5-f719c0235071 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.794930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.795546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.795825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.796097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.796729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] RBAC: Adding query filter params (name=image) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.797027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.798454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.810168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 495/998] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:51.812787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.874188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:51.874382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536578ae-0b3e-4070-8554-3ad7af75c258 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:51.931254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:51.932234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:51.932772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:51.933282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:51.934561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] RBAC: Adding query filter params (interface=public, service_id=f7cd5301340f44f993e29ba2ae50e9bb, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:51.935031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:51.937428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:51.951294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 504/999] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/endpoints?service_id=f7cd5301340f44f993e29ba2ae50e9bb&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:51.952518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:51.984453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3c760-6eee-4591-af02-cb1b7abcbebd None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.028074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.028705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.028984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.029253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.029924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] RBAC: Adding query filter params (type=image) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:52.030234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.030691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:52.031656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffe71e-9413-4f9d-8ba4-d522b4ebe96f None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.036858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 496/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:52.095560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea9ce8-fefb-465b-b8aa-5d6542f5c61e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:52.207687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:52.208657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.209016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.209464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.210277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:52.213610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de929be0-8904-48e6-82b3-ca785d437db7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:52.224517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 505/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:51 2022] GET /identity/v3/services => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:52.258755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82895-71c7-455a-8a7a-7e2a0ff85d36 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.259435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82895-71c7-455a-8a7a-7e2a0ff85d36 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.259435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be82895-71c7-455a-8a7a-7e2a0ff85d36 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.260873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 497/1002] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:52.273478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:52.273852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:52.274897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:52.308893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:52.311360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:52.425974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 506/1003] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:52.902390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82895-71c7-455a-8a7a-7e2a0ff85d36 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.095040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.100330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be82895-71c7-455a-8a7a-7e2a0ff85d36 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.139656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.140311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.140599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.140863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.141464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.142905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:53.153535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:53.155272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 20:01:53.156976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:01:53.158478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 498/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 17 20:01:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:53.161069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.227480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.291264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ca6a9-9281-4604-b211-36189307bc89 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.357152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.358242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.358731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.359222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.360193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:53.360558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.363465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.377179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 507/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:53.378567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.510034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85e54e-eb67-46cb-b113-7f24dee6ccb2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.562571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.563642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.563982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.564408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.565564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:53.566141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.568874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aca214-785c-4a16-869d-81cc6c5b9ed5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.582813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 499/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 17 20:01:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:53.584508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:53.731058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cab2e-c750-41e7-9a41-afb78d909e33 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:53.756298 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:53.775189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:53.775189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:53.775189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:53.775189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:53.775653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:53.775653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd699-d2e7-4503-8305-a4a2c9e9352e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:53.885943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 508/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:54.134274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81f2-b203-467e-9084-f705269c3778 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.134274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81f2-b203-467e-9084-f705269c3778 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.134640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af81f2-b203-467e-9084-f705269c3778 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.136285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 500/1008] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:54.141825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7de9-9508-46d0-b8ca-821a73dba017 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.142218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7de9-9508-46d0-b8ca-821a73dba017 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.142405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7de9-9508-46d0-b8ca-821a73dba017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.162486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-411c7de9-9508-46d0-b8ca-821a73dba017 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:54.163713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-411c7de9-9508-46d0-b8ca-821a73dba017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:54.257103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 509/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:54.257528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f32a-af4d-41b3-8f96-042bb3bb20b9 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.257528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f32a-af4d-41b3-8f96-042bb3bb20b9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.257528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8f32a-af4d-41b3-8f96-042bb3bb20b9 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.259060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 501/1010] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:54.264710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.265007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.265284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.284547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:54.285947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:54.358422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 510/1011] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:54.534319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8f32a-af4d-41b3-8f96-042bb3bb20b9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.565260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.634156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.662644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8f32a-af4d-41b3-8f96-042bb3bb20b9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.680764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.717753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.718644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.718929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.719210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.719898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:54.721353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:54.750928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90339-c1a7-49a8-94b9-e47c5ae34687 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:54.793267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:54.794207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:54.794705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:54.798195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 502/1012] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:54 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:54.798332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:54.798849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:54.800333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:54.810933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:54.814530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:54.815430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 511/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:54.821096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:54.943795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:54.971636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72df26-c53d-49a2-9fbb-d8c7cb1568b0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:55.017677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:55.018376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.018654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.018920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.019551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:55.019838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:55.021217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:55.029789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 503/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:55.036251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:55.211141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509297f2-b3b6-476f-b589-a417760b02c6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:55.213168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:55.255820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:55.256430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.256706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.260872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.260872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:55.260872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:55.260872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766f9d-9fa9-4c6b-86c5-1431fbfce9e0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:55.267481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 512/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 17 20:01:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:55.273348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:55.426830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33d9f-53d8-4aa9-8942-5e986fb8c491 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:55.485120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:55.486076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.486761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.487194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.488334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:55.490707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461283c2-f7e4-469f-9e44-7111fac896fc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:55.574240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 504/1016] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:01:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:01:55.902081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb527-4314-4c20-8614-294d849ece97 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.902265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb527-4314-4c20-8614-294d849ece97 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.902553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fb527-4314-4c20-8614-294d849ece97 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.904063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 513/1017] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:55.909366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:55.909653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:55.909956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:55.916950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:55.929076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:55.944003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:56.010430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 505/1018] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:56.284525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb527-4314-4c20-8614-294d849ece97 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:56.395031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fb527-4314-4c20-8614-294d849ece97 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:56.430603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:56.431240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.431738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.432014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.433147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:56.434626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16b30-5219-4e54-bcfb-fd8f98f6825e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:56.436390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 514/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:56.442156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:56.551485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4c80-511c-4e3d-8718-4558278ed2f1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:56.580587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:56.588568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:56.589190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.589471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.589745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.594334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:56.594334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c59f-2b7b-4ec4-a8e3-8ef5d85023eb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:56.681460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 506/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:01:56 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:56.804549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ee10-9e24-4b13-901b-17b1549e6665 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.804898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ee10-9e24-4b13-901b-17b1549e6665 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.805109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ee10-9e24-4b13-901b-17b1549e6665 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.807226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 515/1021] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:56.816653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:56.816653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:56.816653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:56.835553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:56.837866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:56.929352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 507/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:57.207218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ee10-9e24-4b13-901b-17b1549e6665 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.267590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.363323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ee10-9e24-4b13-901b-17b1549e6665 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.406295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.406999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.407279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.407546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.408132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.409508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:57.420378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:57.421565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:57.422622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 516/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:57.428071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.597579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d83687-5821-4e5e-9b6b-311419ba97b4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.618442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.645529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.646472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.646900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.647319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.648118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] RBAC: Adding query filter params (name=image) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:57.648677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.650261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e853f61-49c4-46c3-8a50-2d5bdf185cce None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.655848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 508/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:57.661944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.706655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c8381-9f3f-4ffa-ae0f-3c21294f5e2e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.707165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c8381-9f3f-4ffa-ae0f-3c21294f5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.707598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c8381-9f3f-4ffa-ae0f-3c21294f5e2e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.710304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 509/1025] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:01:57.716732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.717031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.717304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.738622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:57.740001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:57.771900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:57.777664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86f87-3c47-4e55-9209-d2f56dc208e3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.818704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.819318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.819664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.819930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.821245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:57.821555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.822986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:57.833248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 517/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:57.833459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 510/1027] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:01:57.834551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:57.945040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c5ddf-2fff-46a5-99bb-5af88fb1b4b0 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:57.987653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:57.988354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:57.988736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:57.989139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:57.990141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] RBAC: Adding query filter params (interface=public, service_id=3e66593066dd4cf484e93dbb7384f7ff, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:57.990568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:57.992908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.003533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 518/1028] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:01:57 2022] GET /identity/v3/endpoints?service_id=3e66593066dd4cf484e93dbb7384f7ff&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:58.004869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.132300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.135438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d5421-b9ce-4deb-ac8d-0cc1cf4ac182 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.147142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.167308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.187449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.188066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.188345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.188617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.189231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.190673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.198479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 511/1029] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/services => generated 1957 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:01:58.269024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1a893-534c-4092-9e89-37a256713d28 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.321931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.322604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.322881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.323150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.336546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:01:58.341771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:58.343158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:01:58.344107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:58.346238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 519/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:58.349127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.469593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f901d0-26f1-45e5-9fe6-a375721edbbc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.509650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.510308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.510583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.510885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.511553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:58.511852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.513241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.529993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 512/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:58.533854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.641580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.657930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36750b0-8221-4841-924f-beaf1c329395 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.702146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.702797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.703079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.703353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.714880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.716352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3215711e-f471-4780-9e2e-36fcf42c2b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:58.732386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:58.733374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:58.734328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:58.734328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:58.734328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:58.735220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 520/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:58.739898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:58.775696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:58.824774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996253-f190-42e5-b6e1-2cba62211170 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.825150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996253-f190-42e5-b6e1-2cba62211170 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.825316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4996253-f190-42e5-b6e1-2cba62211170 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.826776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 521/1033] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:01:58.832684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.833016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.833244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.854584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:01:58.855836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:01:58.874917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94e40-24a2-4325-92fe-49852d549da6 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:58.921317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:58.922000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:58.922331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:58.922608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:58.923269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:58.923569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:58.925961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:58.940454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 522/1034] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:01:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:01:58.944323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 513/1035] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:01:58.950568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.059091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.108158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5548f-cc50-4324-8c21-80ce0abeceed None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.149153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.150305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.150305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.150584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.159355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.160883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:01:59.176121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:59.177134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:01:59.178258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:59.182368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 523/1036] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:01:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:01:59.184493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.233173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.311353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.323383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26c983-e07c-4e87-a43a-47f3fac44cee None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.366317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642f6a7-8432-4c68-9277-ff7eec58b165 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.369452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.370097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.370382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.370643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.371379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:01:59.371675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.373116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.399773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 514/1037] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:59.405996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.409749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.423418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.423864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.424142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.434041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.434041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.434041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.434041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 524/1038] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:01:59.435337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.521566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5750cee-e978-4407-b12c-b59583c4bcb3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.561998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c759a3-e0c8-4c3b-873f-0b34272cea57 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.568122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.568751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.569023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.569743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.590347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.600570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.601192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.602023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.602313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.602966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.604474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.648345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.649935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.716018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 525/1039] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:01:59 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:01:59.768713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 515/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:01:59.775877 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:01:59.841253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:01:59.897894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4ec14-82a7-42ac-a58f-f8f04f2c1bd5 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:01:59.938311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:01:59.938593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:01:59.938777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:01:59.939045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:01:59.952582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:01:59.954121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:01:59.969960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:01:59.970962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:01:59.971965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:01:59.971965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:01:59.971965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:01:59.971965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 526/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:01:59.978118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.028544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:00.083735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d50d-1893-4bbf-ba07-9b03f5b2cd16 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.121714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.122580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.123004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.123492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.124322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:00.124766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.126314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599db5c-f786-4d47-85e9-44eb21108688 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.139561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 516/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:00.145084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.216169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83e6c-95a5-475b-a0df-d5d6e58ec39d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.216499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83e6c-95a5-475b-a0df-d5d6e58ec39d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.216739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83e6c-95a5-475b-a0df-d5d6e58ec39d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.218269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 517/1043] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:02:00.223377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.223674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.223941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.243273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:00.244512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:00.262557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52e1d8-336d-4e4a-82a6-4ed7745a026e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.265657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:00.301809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.302587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.302868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.303128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.311161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.312614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:02:00.325633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:00.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:00.327672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 527/1044] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:00.332840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.336551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 518/1045] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:00.442982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073029b-3e24-44e4-8dfc-8adfeca9582b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.478950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.479562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.479837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.480102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.480785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:00.481084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.482526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.496095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 528/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:00.502060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.543910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:00.605790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4192ae3-4464-462a-a9af-dbc84e7a6232 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.607792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.637329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:00.648096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.649548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.649999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.650278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.651072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] RBAC: Adding query filter params (role.id=85d07b40a7e347a994d771c7ea733c82, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:00.651384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.652883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.666268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 519/1047] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=85d07b40a7e347a994d771c7ea733c82 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:00.729121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0139a4d-e8b3-4c84-b519-5ce16619ceb8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.770236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.770891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.771172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.771441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] PATH_INFO: `/v3/services/image` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.772040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.773514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:00.783527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:00.784629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:00.785527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 529/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:00.792566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:00.918005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa473b-0153-4eaf-bd16-7699ddf82f8e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:00.920032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:00.954625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:00.955300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:00.955583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:00.955854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:00.956489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] RBAC: Adding query filter params (name=image) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:00.956812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:00.958262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:00.968917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 520/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:00.970221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.064430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.077579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce93f9-79a9-44d0-9af6-fa598846ff4b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.113452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.114106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.114392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.114667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.115295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:01.115600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.119108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd38dee-e112-4563-9e65-305d3d03afb9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.125410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 530/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:01.132156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:01.246598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971aa7a-55b1-4609-90f9-0f63ac86fecf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:01.304526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:01.306100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.306769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.307246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.308192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:01.309904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc93416-6dbc-4b63-92fe-625c35b43982 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:01.418367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 521/1051] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:02:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:02:01.741629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42021b4-6c14-4f2f-9a25-b378fd176952 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.742705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42021b4-6c14-4f2f-9a25-b378fd176952 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.742705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42021b4-6c14-4f2f-9a25-b378fd176952 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.744222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 531/1052] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:01.749680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:01.750034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:01.750267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:01.770233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:01.771506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:01.791700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:01.859817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 522/1053] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:02.128578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42021b4-6c14-4f2f-9a25-b378fd176952 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.274321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42021b4-6c14-4f2f-9a25-b378fd176952 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.316189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.316830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.317103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.317369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.338400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:02.343357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:02.345165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:02.348038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 532/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:02.357246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.475141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aabc2-4a4f-427a-830b-97e6f8654ef8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.515541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.516185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.516427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.516699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.517374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:02.517670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.519160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b5c5-a00c-4e88-b9ab-6c5ddc669f9d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.533942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 523/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:02.537161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.555958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.649325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a1-2b83-4401-a4c5-825fc9628192 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.649776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a1-2b83-4401-a4c5-825fc9628192 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.650090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a31a1-2b83-4401-a4c5-825fc9628192 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.651443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 524/1056] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:02.658360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.658360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.658360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.658710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdad252-0196-4793-a1c9-53e7b6ff16b1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.677154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:02.678546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:02.682518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.696715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.697353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.697633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.697929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] PATH_INFO: `/v3/users/e93898c853974bfb9ad4de64567829ea` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.715567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] RBAC: Authorizing `identity:get_user(user_id=e93898c853974bfb9ad4de64567829ea)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.717174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:02.719308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 533/1057] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/users/e93898c853974bfb9ad4de64567829ea => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:02.728606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:02.768116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 525/1058] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:02.811061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:02.848932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c143a8-6dd2-49ae-b085-2e41e281f133 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:02.890386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:02.891072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:02.891502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:02.891780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:02.970207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:02.971670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.041727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.053816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.091247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 534/1059] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:02:03.097293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.184806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e3a13-3f30-4ff0-bad4-2c5a82502789 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.228212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410ff4-2bc8-4bf0-8dbf-1b140450ea48 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.233241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.234348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.234839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.235313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.251058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.254822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:03.260039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:03.270673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 526/1060] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:03.272399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.285549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.286209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.286495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.286760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.287940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.289941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.297220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 535/1061] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:03.298696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.358083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.405650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a2e31-387f-40c7-9535-617a90963601 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.431393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bde8a6-5741-40b2-aaac-eb1d3a7cd15c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.453470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.454119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.454402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.454670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.455356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.455655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.457870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.470299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 527/1062] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:03.475689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.476880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.477061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.477364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.477821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.478692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=a6966efb64034755a2c0b1faba724a95, user.id=e93898c853974bfb9ad4de64567829ea) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.479006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.480468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd03be-5cc2-446e-9fdf-45e9bdc2edd8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.497909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 536/1063] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/role_assignments?user.id=e93898c853974bfb9ad4de64567829ea&scope.project.id=a6966efb64034755a2c0b1faba724a95&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:03.506162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013cda-06a2-49fc-94b1-3591728b5f91 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.506480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013cda-06a2-49fc-94b1-3591728b5f91 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.506710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15013cda-06a2-49fc-94b1-3591728b5f91 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.508966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 537/1064] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:02:03.516304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.516665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.516867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.537223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:03.539017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:03.574632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.625918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 538/1065] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:03.626150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bdca7-0863-4fc0-a970-346981d81210 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.675608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.676280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.676563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.676840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.690909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.692517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:03.710332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:03.711408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:03.712370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:03.712370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:03.712370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:03.712370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 528/1066] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:03.717925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.752741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:03.854984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c1c0-79a0-4aee-b563-eadeee66e9ae None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:03.897287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:03.898460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:03.898734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:03.898914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:03.899375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:03.900066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:03.900369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:03.903305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:03.917925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 539/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:03.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.027056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b0c96-2ec7-4dd7-a3eb-5254cd21e2c7 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.045769 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.049513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.059750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71604b33-df22-4d4c-b187-9adc8c17f959 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.075782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.076440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.077000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.077000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.113337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.114143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.114424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.114672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.125039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.126892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:02:04.140186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:04.141228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:04.142365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 540/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:04.147289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.167505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.169169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.287857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f460a2c-e9c1-4ef6-bcf3-6dbe9603c041 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.325935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 529/1069] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:02:04.330411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.336630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.337380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.337757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.340005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.340005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:04.340005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.341180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.351761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.378814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 541/1070] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:04.378814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.386205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.463652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb1b6-80a5-494c-af7c-dc8dc2b67548 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.511794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11659519-eebb-4f5b-909f-424f772713e9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.526807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.527470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.527747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.528019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.543168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.543450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.563488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:04.569367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:04.571218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:04.572339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:04.572339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:04.572339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:04.572547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.572547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.572547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.572800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 530/1071] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:04.574311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.579830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.581306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:04.597904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:04.606231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:04.607477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:04.607477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:04.607477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:04.607477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 542/1072] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:04.610171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.661710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.685829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.702290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703ddc-d013-4460-be3e-17f1086c3829 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.728838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b1ffd-bfec-4ab6-9b03-68251dfa9427 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.745024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.746118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.746639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.747148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.748381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:04.748942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.751490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.764953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.765684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.766089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.766460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.767196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:04.767597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.769055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.782230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 531/1073] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:04.789020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 543/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:04.795112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:04.920501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4974a5d-b9cb-40ca-9383-c6ce6d662f22 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:04.951670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:04.961113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:04.965239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:04.965239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:04.965239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:04.970578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:04.972046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:02:04.984602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:04.985855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:04.986971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:04.989154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 532/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:04.995584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.125571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee934f-00bc-48d2-980f-3c34f7f82acd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:05.151066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:05.162487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:05.166249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a046a06-a158-4630-b187-8b8781718a60 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:05.177962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 544/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:02:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:05.184777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.302819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514c961-5288-47f8-816e-fdb3bdda9c46 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:05.337187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:05.337862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.338162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.338434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/85d07b40a7e347a994d771c7ea733c82` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.340577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=dd12e6654aad484d8edb0b82f86ba8ef, role_id=85d07b40a7e347a994d771c7ea733c82)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:05.342057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef0f76-8359-4461-a181-11413a7ae39a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:05.390184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 533/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:05 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/dd12e6654aad484d8edb0b82f86ba8ef/roles/85d07b40a7e347a994d771c7ea733c82 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:05.498258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bd006-785a-4ed9-8e1c-45d3811b7968 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.498583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bd006-785a-4ed9-8e1c-45d3811b7968 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.498882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bd006-785a-4ed9-8e1c-45d3811b7968 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.500274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 545/1078] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:05.506656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:05.507068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:05.507492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:05.527166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:05.528404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:05.577087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:05.605849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 534/1079] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:05.881256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bd006-785a-4ed9-8e1c-45d3811b7968 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:05.986561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bd006-785a-4ed9-8e1c-45d3811b7968 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:06.020776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:06.021418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:06.021660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:06.021950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:06.033474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:06.038254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:06.039766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:06.040661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 546/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:06.046217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:06.146325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12ef0d-e955-4fed-9aab-932dd914eeff None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:06.181083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:06.181690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:06.181995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:06.182271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:06.182931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:06.183232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:06.184605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:06.192704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 535/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:06.199732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:06.244944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:06.303382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e412ba-9b11-489a-8925-ab483305228c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:06.337583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:06.338273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:06.338547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:06.338814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] PATH_INFO: `/v3/users/e93898c853974bfb9ad4de64567829ea` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:06.339919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] RBAC: Authorizing `identity:get_user(user_id=e93898c853974bfb9ad4de64567829ea)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:06.341347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:06.342967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 547/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:06 2022] GET /identity/v3/users/e93898c853974bfb9ad4de64567829ea => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:06.348691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:06.389474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:06.450607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413da89-3d9b-4e13-a1d1-09cf6fc29170 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:06.486019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:06.486648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:06.486928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:06.487200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:06.488311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:06.489753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8642a61-5ac9-49fb-8462-2a46ed94589c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:06.492082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 536/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:06 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:06.498100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:06.596869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946a0c-ff51-4af4-96d0-885f3dc12f12 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:06.607476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:06.631589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:06.632362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:06.632650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:06.632925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95/users/e93898c853974bfb9ad4de64567829ea/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:06.635097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] RBAC: Authorizing `identity:create_grant(project_id=a6966efb64034755a2c0b1faba724a95, user_id=e93898c853974bfb9ad4de64567829ea, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:06.636580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86668f6-429b-4c75-b296-591cf229601d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:06.686626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 548/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:06 2022] PUT /identity/v3/projects/a6966efb64034755a2c0b1faba724a95/users/e93898c853974bfb9ad4de64567829ea/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:07.300681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19cc-1f74-4c89-be9c-44904da7aa3e None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.301201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19cc-1f74-4c89-be9c-44904da7aa3e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.301201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f19cc-1f74-4c89-be9c-44904da7aa3e None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.302587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 537/1085] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:07.308574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.309055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.309153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.326880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:07.328057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:07.393998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 549/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:07.661056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f19cc-1f74-4c89-be9c-44904da7aa3e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:07.764856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f19cc-1f74-4c89-be9c-44904da7aa3e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:07.772018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:07.798732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:07.799359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.799637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.799907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.810531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:07.815194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:07.816929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:07.818505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 538/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 17 20:02:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:07.822489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:07.920605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:07.923402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e44426-2090-46e7-9975-5f5b2dde7530 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:07.957693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:07.958315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:07.958590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:07.958855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:07.959504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:07.959869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:07.961212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:07.969689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 550/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:02:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:07.976991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.083950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127b43-2b4e-4f27-b06a-a2fa07143275 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.119545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.120222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.120509 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.120784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.132048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.133703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:08.149651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:08.150927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:08.152038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:08.152038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:08.152038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:08.152038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 539/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:08.156901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.266570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5defdc-1a27-486d-95e9-871056414d57 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.307826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.308437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.308715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.309319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.309623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:08.309944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.311318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.324350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 551/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:08.330859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.350695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.434662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab9fdd-338c-4ba9-afd2-6bc91fbeabc0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.470320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.470948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.471222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.471487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.480207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.481651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7c5698d8-30db-4599-bff7-2619194e5f83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:02:08.492860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:08.494157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 20:02:08.495345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:08.499039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 540/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:08.499886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.527273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.603135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45adf-fd6a-4a9b-8bfa-4d6aaf4140de None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.603415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45adf-fd6a-4a9b-8bfa-4d6aaf4140de None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.603686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45adf-fd6a-4a9b-8bfa-4d6aaf4140de None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.605039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 541/1092] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:02:08.611515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.611804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.612083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.612314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ab6e-e2c9-4a39-8f70-8dbeb656266e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.633213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:08.634510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:08.650378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.650992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.651275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.651546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.652286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:08.652590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.654059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.684054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 552/1093] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:08.685312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.707177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 542/1094] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:08.767393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.794469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702d599-9b07-4874-b066-a5a36acab97f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:08.821284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:08.821912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:08.822197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:08.822469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:08.889254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:08.890733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:08.970379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.973935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:08.984027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:08.990650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 553/1095] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:08.997005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.074976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4189e2a-81d0-4c3f-b6db-56275d388a6a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.098619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0752b-7ded-487b-8c6b-b930fbc748bb None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.110033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.110992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.111273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.111542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.122598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:09.127331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:09.128353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:09.129218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 543/1096] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:09.135164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.136821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.137449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.137722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.138020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.148486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.149955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:09.164609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:09.165778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:02:09.166755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:09.166755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:02:09.166755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:09.166755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 554/1097] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:09.171428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.203464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.208155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.240534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afccd-fec2-49fe-acd4-4b69b569344e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.276162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136f3f-a5e4-4a5d-98f1-674724c52557 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.278518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.279128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.279407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.279676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.280332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:09.280633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.282032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.290585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 544/1098] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:09.296277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.311997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.312611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.312894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.313164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.313803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:09.314135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.315505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.327968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 555/1099] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:09.333579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.397818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de516cc-c246-4086-80be-f59532a8e0a0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.424812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.426681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.433195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.433829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.437302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.437409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a9c4-5a7f-41ae-94dd-e8ba21693246 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.437518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] PATH_INFO: `/v3/users/e93898c853974bfb9ad4de64567829ea` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.437518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] RBAC: Authorizing `identity:get_user(user_id=e93898c853974bfb9ad4de64567829ea)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.437518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.443289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 545/1100] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/users/e93898c853974bfb9ad4de64567829ea => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:09.444495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.468854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.471717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.471717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.471717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.478118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.479571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:02:09.491702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:09.492985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:09.494058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 556/1101] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 20:02:09.498713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.549579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520498af-8596-4a91-8c16-f475d4525a1c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.586525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.587066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.587349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.587624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.603256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad0e18-7349-4ace-83c8-e08c717c6e7b None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.646137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.646742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.647015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.647630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.648330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:09.648620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.650061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.656071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.659563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.661030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.661856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 557/1102] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:09.668554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.683765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.764466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 546/1103] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:02:09.770103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0ae3c-7760-48c6-96cc-d5f1bf877321 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.770336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:09.805143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.805741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.806052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.806323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.807037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] RBAC: Adding query filter params (role.id=85d07b40a7e347a994d771c7ea733c82, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=dd12e6654aad484d8edb0b82f86ba8ef) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:09.807340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.808765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.814822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 558/1104] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/role_assignments?user.id=dd12e6654aad484d8edb0b82f86ba8ef&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=85d07b40a7e347a994d771c7ea733c82 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:09.873014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:09.877019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323be3e-1aff-4773-937a-2cc2b06b3923 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:09.915631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:09.916289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:09.916572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:09.916848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:09.918054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:09.919530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704496b3-056b-4b1b-a985-c8829aab75d1 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:09.921224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 547/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:09.927570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:10.013028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:10.036018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5856a-db6f-40ce-852c-fd63438971c5 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:10.073736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:10.074386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:10.074661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:10.075008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:10.075739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=a6966efb64034755a2c0b1faba724a95, user.id=e93898c853974bfb9ad4de64567829ea) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:10.076046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:10.077507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e54afc-369b-4d6b-bfef-e41c94982f20 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:10.083845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 559/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:09 2022] GET /identity/v3/role_assignments?user.id=e93898c853974bfb9ad4de64567829ea&scope.project.id=a6966efb64034755a2c0b1faba724a95&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:12.048695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827bf8-c3fc-43ed-a15d-e5e59421988c None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:12.049223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827bf8-c3fc-43ed-a15d-e5e59421988c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:12.049223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827bf8-c3fc-43ed-a15d-e5e59421988c None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:12.055033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 548/1107] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:12.056683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:12.057099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:12.057251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:12.075577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:12.076785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:12.144335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 560/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:12.420638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827bf8-c3fc-43ed-a15d-e5e59421988c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:12.520257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827bf8-c3fc-43ed-a15d-e5e59421988c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:12.553575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:12.554221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:12.554501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:12.554772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:12.555896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:12.557339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c5949-8eb2-4a68-9ad8-ad7a513474bb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:12.558952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 549/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:12.564768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:12.633739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:12.664536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1345c93-259a-4267-b00f-dca505b130f0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:12.698605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:12.699155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:12.699427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:12.699690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:12.700454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:12.701902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ec3b4-64f2-485e-a963-d6a4bc7256eb None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:12.806511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 561/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:12 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:14.767572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3046-f97f-4752-8630-3ce18e4f8d3b None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:14.768146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3046-f97f-4752-8630-3ce18e4f8d3b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:14.768146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3046-f97f-4752-8630-3ce18e4f8d3b None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:14.769420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 550/1111] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:14.774943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160758fc-3294-4791-95c6-754e517d0067 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:14.775343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160758fc-3294-4791-95c6-754e517d0067 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:14.775486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160758fc-3294-4791-95c6-754e517d0067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:14.793750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-160758fc-3294-4791-95c6-754e517d0067 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:14.794955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-160758fc-3294-4791-95c6-754e517d0067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:14.861546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 562/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:15.131840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec3046-f97f-4752-8630-3ce18e4f8d3b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:15.168142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:15.234153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec3046-f97f-4752-8630-3ce18e4f8d3b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:15.269009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:15.269642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:15.270019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:15.270294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] PATH_INFO: `/v3/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:15.272342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] RBAC: Authorizing `identity:get_role(role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:15.274086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:15.275412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 551/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:15 2022] GET /identity/v3/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:15.281382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160758fc-3294-4791-95c6-754e517d0067 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:15.337218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:15.380550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160758fc-3294-4791-95c6-754e517d0067 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:15.414960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:15.415589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:15.415865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:15.416173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] PATH_INFO: `/v3/users/6eea16cb894b427a94c196d9f0489501` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:15.429685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] RBAC: Authorizing `identity:get_user(user_id=6eea16cb894b427a94c196d9f0489501)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:15.431155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:15.432806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 563/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:15 2022] GET /identity/v3/users/6eea16cb894b427a94c196d9f0489501 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:15.438680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:15.540046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b40b1-ba5c-4be2-881d-cf84985dc011 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:15.541568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:15.574800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:15.575428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:15.575705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:15.575974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:15.641678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:15.643166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:15.740809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 552/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:15.746761 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:15.845723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4bf63-2a52-4cac-9b23-7e39a8494229 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:15.860592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:15.880929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:15.881560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:15.881836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:15.882142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:15.883287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:15.884718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a666c-f83d-4921-93b2-35d89e9dd8ed None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:15.886400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 564/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:15 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:15.892905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:15.895115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:15.993152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0999c0-8a75-466d-8499-614a11a79f68 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:16.026894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:16.027489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:16.027764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:16.028031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:16.028740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=a6966efb64034755a2c0b1faba724a95, user.id=6eea16cb894b427a94c196d9f0489501) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:16.029037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:16.030496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb996c-97b8-44ca-a4a7-5323afdc1deb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:16.035644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 553/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:15 2022] GET /identity/v3/role_assignments?user.id=6eea16cb894b427a94c196d9f0489501&scope.project.id=a6966efb64034755a2c0b1faba724a95&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:17.937565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3041a-bd0d-4376-87a2-cd28ab2977f2 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:17.938168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3041a-bd0d-4376-87a2-cd28ab2977f2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:17.938168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3041a-bd0d-4376-87a2-cd28ab2977f2 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:17.939474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 565/1118] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:17.944570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:17.944976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:17.945121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:17.963891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:17.965079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:18.023643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:18.031165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 554/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:18.306865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3041a-bd0d-4376-87a2-cd28ab2977f2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:18.407658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3041a-bd0d-4376-87a2-cd28ab2977f2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:18.441149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:18.441770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:18.442080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:18.442352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] PATH_INFO: `/v3/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:18.443906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] RBAC: Authorizing `identity:get_role(role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:18.445284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:18.446643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 566/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:18 2022] GET /identity/v3/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:18.452536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:18.551928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c2c07-f35a-49a6-97d6-6ecad3db931f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:18.585464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:18.586109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:18.586388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:18.586659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] PATH_INFO: `/v3/users/6eea16cb894b427a94c196d9f0489501` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:18.587758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] RBAC: Authorizing `identity:get_user(user_id=6eea16cb894b427a94c196d9f0489501)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:18.589189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:18.590781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 555/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:18 2022] GET /identity/v3/users/6eea16cb894b427a94c196d9f0489501 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:18.596666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:18.650554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:18.700478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6139e5-7096-4584-b6cb-80f1e33a3103 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:18.735214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:18.735835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:18.736116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:18.736388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:18.737488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:18.738947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff88e74-d204-4400-acee-cbe2533c8c34 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:18.740622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 567/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:18 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:18.746852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:18.807856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:18.844640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba628129-1e86-47ce-ba9e-71cdd2b48513 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:18.878374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:18.879021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:18.879296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:18.879565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95/users/6eea16cb894b427a94c196d9f0489501/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:18.881806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6966efb64034755a2c0b1faba724a95, user_id=6eea16cb894b427a94c196d9f0489501, role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:18.883255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befe054-8f8a-41a6-97ad-1bcbe68eaeb0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:18.965314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 556/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:18 2022] PUT /identity/v3/projects/a6966efb64034755a2c0b1faba724a95/users/6eea16cb894b427a94c196d9f0489501/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:02:20.883126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac8c7-34fb-482b-864e-5418ae05b91c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:20.883681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac8c7-34fb-482b-864e-5418ae05b91c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:20.883681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac8c7-34fb-482b-864e-5418ae05b91c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:20.885033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 568/1124] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:20.890327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:20.890757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:20.890859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:20.909379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:20.910615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:20.977322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 557/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:21.252833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac8c7-34fb-482b-864e-5418ae05b91c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:21.351509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac8c7-34fb-482b-864e-5418ae05b91c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:21.368846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:21.384619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] PATH_INFO: `/v3/roles/241ecf446feb46f1b9f7f7e89325be62` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] RBAC: Authorizing `identity:get_role(role_id=241ecf446feb46f1b9f7f7e89325be62)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:21.392806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 569/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:21 2022] GET /identity/v3/roles/241ecf446feb46f1b9f7f7e89325be62 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:21.396060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:21.451906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:21.497154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640cb20-1117-4ffb-9be1-5061ad1c0933 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:21.532054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:21.532604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:21.532886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:21.533158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] PATH_INFO: `/v3/users/6eea16cb894b427a94c196d9f0489501` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:21.534311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6eea16cb894b427a94c196d9f0489501)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:21.535754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:21.537899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 558/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:21 2022] GET /identity/v3/users/6eea16cb894b427a94c196d9f0489501 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:21.543932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:21.646466 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb1867-33ca-4c09-9a87-e2295a9b7511 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:21.680919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:21.681515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:21.681796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:21.682095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:21.735527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:21.748358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:21.749790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:21.846191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 570/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:21.853066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:21.951207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88891033-5939-4b13-8060-8d21a36e04d8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:21.973543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:21.986157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:21.986789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:21.987564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:21.987564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] PATH_INFO: `/v3/projects/a6966efb64034755a2c0b1faba724a95` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:21.988656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] RBAC: Authorizing `identity:get_project(project_id=a6966efb64034755a2c0b1faba724a95)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:21.990162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68bb6-a9fc-4c5a-83ab-0c1c8fe7e694 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:21.991948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 559/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:21 2022] GET /identity/v3/projects/a6966efb64034755a2c0b1faba724a95 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:21.998543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:22.084161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:22.101929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84bd3-32ed-4876-93cc-0143e935f5de None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:22.132594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:22.133190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:22.133463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:22.133729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:22.134467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] RBAC: Adding query filter params (role.id=241ecf446feb46f1b9f7f7e89325be62, scope.project.id=a6966efb64034755a2c0b1faba724a95, user.id=6eea16cb894b427a94c196d9f0489501) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:22.134766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:22.136169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1855d-4228-48b1-918a-645e5cd65eef None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:22.141828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 571/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:21 2022] GET /identity/v3/role_assignments?user.id=6eea16cb894b427a94c196d9f0489501&scope.project.id=a6966efb64034755a2c0b1faba724a95&role.id=241ecf446feb46f1b9f7f7e89325be62 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:24.096014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e96-4302-481a-aaca-871bbb3b21e7 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:24.096553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e96-4302-481a-aaca-871bbb3b21e7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:24.096553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29e96-4302-481a-aaca-871bbb3b21e7 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:24.097931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 560/1131] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:24.104217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:24.104648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:24.104758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:24.123617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:24.124809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:24.193127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 572/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:24.464886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29e96-4302-481a-aaca-871bbb3b21e7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:24.564470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29e96-4302-481a-aaca-871bbb3b21e7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:24.599641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:24.600258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:24.600534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:24.600803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:24.602061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:24.603513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84394495-6843-4dfd-ae14-b7dce1b7c418 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:24.605129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 561/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:24.611354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:24.693266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:24.711913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241b0a-d4ab-43e1-a7e7-035a94036366 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:24.746266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:24.746803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:24.747079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:24.747350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:24.748007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:24.749486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1b42-48b5-44d6-bae3-33d0dd40baa0 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:24.856959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 573/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:02:24 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:26.830192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892117-5fd6-4870-b884-8b9663a47737 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.830731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892117-5fd6-4870-b884-8b9663a47737 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.830731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892117-5fd6-4870-b884-8b9663a47737 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.832060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 562/1135] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:26.837674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:26.838156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:26.838249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:26.856823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:26.858068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:26.925509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 574/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:27.197836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892117-5fd6-4870-b884-8b9663a47737 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:27.257951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:27.298728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892117-5fd6-4870-b884-8b9663a47737 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:27.333309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:27.333965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:27.334247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:27.334520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:27.335642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:27.337092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a2ffe-7d67-4e52-9cb7-2fa98efc1807 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:27.338700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 563/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:27.344497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:27.404651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:27.441706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2087-b510-4cac-a81d-cf2bc5b8fd2f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:27.476213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:27.476737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:27.477014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:27.477284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:27.477944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:27.479372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d4fc9-27ec-417d-b468-f37aa467b188 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:27.544690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 575/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:27 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:29.487769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141f91-424d-4daa-8d20-97b582175e88 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.488330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141f91-424d-4daa-8d20-97b582175e88 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.488330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81141f91-424d-4daa-8d20-97b582175e88 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.490218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 564/1139] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:29.495589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.496060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.496166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:29.514954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:29.516068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:29.581998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 576/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:29.855753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141f91-424d-4daa-8d20-97b582175e88 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:29.957110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81141f91-424d-4daa-8d20-97b582175e88 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:29.986058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:29.995661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:29.996319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:29.998779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:29.998779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.008852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:30.013822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:30.015034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:30.016155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 565/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:30.022084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:30.076629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:30.127648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d677f4-73f4-49e6-a640-74b53d68511a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:30.161576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:30.162212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:30.162496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:30.162970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.163805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:30.164652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:30.166076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.174004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 577/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:30.180418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:30.282034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3d281-0c74-4cad-9e4f-7e1a00d7e63e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:30.316361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:30.317679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:30.317985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:30.318261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] PATH_INFO: `/v3/users/3ff2abca9f184706994c10e0ccffe1f9` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.332051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] RBAC: Authorizing `identity:get_user(user_id=3ff2abca9f184706994c10e0ccffe1f9)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:30.333547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.335187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 566/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:30 2022] GET /identity/v3/users/3ff2abca9f184706994c10e0ccffe1f9 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:30.341221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:30.441144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e91ba8-54eb-4122-a826-445c6edb2082 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:30.451596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:30.474336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:30.475007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:30.475282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:30.475546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.540965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:30.542439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.639458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 578/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:30.645662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:30.690804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:30.743472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0398e-5ec6-498f-8a7e-eb2d6b193c7e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:30.776471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:30.777093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:30.777371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:30.777642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] PATH_INFO: `/v3/projects/0446048c13c94543ab1945163972b60c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.778772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] RBAC: Authorizing `identity:get_project(project_id=0446048c13c94543ab1945163972b60c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:30.780207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57b999-a4ad-45c5-9401-1fae068e1b66 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.781810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 567/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:30 2022] GET /identity/v3/projects/0446048c13c94543ab1945163972b60c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:30.788792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:30.800134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:30.888153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a222c6-658b-43cf-8eef-da0c634cf922 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:30.925685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:30.926337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:30.926620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:30.926894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:30.927618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=0446048c13c94543ab1945163972b60c, user.id=3ff2abca9f184706994c10e0ccffe1f9) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:30.927926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:30.929365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b493cd-05c4-480d-a3d2-9f57372c826c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:30.934920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 579/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:30 2022] GET /identity/v3/role_assignments?user.id=3ff2abca9f184706994c10e0ccffe1f9&scope.project.id=0446048c13c94543ab1945163972b60c&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:32.895624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17671f-0dc0-4e80-a076-6a7e29da1faa None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:32.896160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17671f-0dc0-4e80-a076-6a7e29da1faa None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:32.896160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17671f-0dc0-4e80-a076-6a7e29da1faa None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:32.897497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 568/1147] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:32.902934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:32.903364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:32.903456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:32.921197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:32.922400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:32.988092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 580/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:33.262269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17671f-0dc0-4e80-a076-6a7e29da1faa None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:33.361478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17671f-0dc0-4e80-a076-6a7e29da1faa None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:33.374788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:33.395434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:33.396053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:33.396331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:33.396600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:33.406758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:33.411990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:33.413745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:33.415433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 569/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:33.420981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:33.424067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:33.518162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f6510-1810-4caf-9754-f027bdc581f8 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:33.553975 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:33.554587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:33.554864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:33.555130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:33.555789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:33.556088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:33.557448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:33.565474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 581/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:33.571434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:33.672124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c5f2-4055-4bd0-9cec-64af553101f3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:33.705090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:33.705714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:33.706022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:33.706293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] PATH_INFO: `/v3/users/3ff2abca9f184706994c10e0ccffe1f9` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:33.708034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] RBAC: Authorizing `identity:get_user(user_id=3ff2abca9f184706994c10e0ccffe1f9)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:33.709458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:33.711046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 570/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:33 2022] GET /identity/v3/users/3ff2abca9f184706994c10e0ccffe1f9 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:33.716938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:33.781131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:33.815350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8bc8a-8ba6-469e-a0f0-bab498e363dc None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:33.848892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:33.849502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:33.849782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:33.850084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] PATH_INFO: `/v3/projects/0446048c13c94543ab1945163972b60c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:33.851188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] RBAC: Authorizing `identity:get_project(project_id=0446048c13c94543ab1945163972b60c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:33.852640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa75736-098c-4b08-8661-1a8c80f3c898 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:33.854303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 582/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:33 2022] GET /identity/v3/projects/0446048c13c94543ab1945163972b60c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:33.860593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:33.904785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:33.962881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951537a2-f36f-42ad-a0ba-c82ee662dc78 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:33.996901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:33.997555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:33.997837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:33.998141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] PATH_INFO: `/v3/projects/0446048c13c94543ab1945163972b60c/users/3ff2abca9f184706994c10e0ccffe1f9/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:34.000049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0446048c13c94543ab1945163972b60c, user_id=3ff2abca9f184706994c10e0ccffe1f9, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:34.001522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e99678-20f6-49bf-8b09-43f54430e4c0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:34.135920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 571/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:33 2022] PUT /identity/v3/projects/0446048c13c94543ab1945163972b60c/users/3ff2abca9f184706994c10e0ccffe1f9/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:36.041476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c177-c368-483d-b4fa-cc1033c37e79 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:36.042083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c177-c368-483d-b4fa-cc1033c37e79 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:36.042083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82c177-c368-483d-b4fa-cc1033c37e79 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:36.043382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 583/1154] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:36.048609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:36.049039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:36.049177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:36.067161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:36.068342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:36.144416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 572/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:36.414393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c177-c368-483d-b4fa-cc1033c37e79 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:36.512465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82c177-c368-483d-b4fa-cc1033c37e79 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:36.544547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:36.545158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:36.545433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:36.545698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:36.547618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:36.556412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:36.569559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:36.571046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:36.572210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 584/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:36.573157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:36.599790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:36.673031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a2666-beac-4403-8fd4-705c5e0a7fc6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:36.707496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:36.708093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:36.708367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:36.708632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:36.709285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:36.709579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:36.710989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:36.718886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 573/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:36.725504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:36.823714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aac2d-0494-4953-a2a8-4b3234a80af6 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:36.856834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:36.857468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:36.858028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:36.858301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] PATH_INFO: `/v3/users/3ff2abca9f184706994c10e0ccffe1f9` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:36.859422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] RBAC: Authorizing `identity:get_user(user_id=3ff2abca9f184706994c10e0ccffe1f9)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:36.860855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:36.862472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 585/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:36 2022] GET /identity/v3/users/3ff2abca9f184706994c10e0ccffe1f9 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:36.868608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:36.958659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:36.966752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605f568-3c96-4895-ac99-5ed37e082cdf None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:37.000390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:37.000989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.001269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.001534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.068681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:37.070193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:37.158064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:37.167623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 574/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:37.173905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:37.239233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:37.279495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e63171-a496-4ba8-81d4-3707d957b2dd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:37.314314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:37.314967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.315265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.315569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] PATH_INFO: `/v3/projects/0446048c13c94543ab1945163972b60c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.317267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0446048c13c94543ab1945163972b60c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:37.318742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8127b4-d238-45c0-a53d-556c94d587a1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:37.320387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 586/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:37 2022] GET /identity/v3/projects/0446048c13c94543ab1945163972b60c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:37.326579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:37.424065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb82ae-e347-4274-9c0d-fb3cf098b777 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:37.458338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:37.458938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:37.459218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:37.459492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:37.460212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=0446048c13c94543ab1945163972b60c, user.id=3ff2abca9f184706994c10e0ccffe1f9) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:37.460520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:37.461979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25f9d-0a1b-43ff-b0db-1505fa558167 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:37.467604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 575/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:37 2022] GET /identity/v3/role_assignments?user.id=3ff2abca9f184706994c10e0ccffe1f9&scope.project.id=0446048c13c94543ab1945163972b60c&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:39.458891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2aa0-adcd-4561-bb91-3745a4e60e9f None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:39.459445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2aa0-adcd-4561-bb91-3745a4e60e9f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:39.459445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b2aa0-adcd-4561-bb91-3745a4e60e9f None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:39.460786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 587/1162] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:39.466005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:39.466400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:39.466564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:39.485281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:39.486516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:39.537801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:39.554968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 576/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:39.829384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2aa0-adcd-4561-bb91-3745a4e60e9f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:39.931575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b2aa0-adcd-4561-bb91-3745a4e60e9f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:39.960204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:39.966064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:39.966667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:39.966969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:39.967241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.037005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:40.038488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:40.135156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 588/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:02:40.141050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.237543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d85c0b-1418-4775-b164-19baec20a5f6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.274083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.274765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.275039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.275307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.282143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:40.283616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-89930759-4f04-4ccc-9422-70f96a385f9c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:40.301698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:40.303052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:40.303928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 577/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:40.309930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:40.341179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:40.411813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd0e8-84fd-4464-93b9-ab5b813570dd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:40.447524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:40.448131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:40.448407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:40.448675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:40.449315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:40.449612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:40.451121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dbcf5-196e-4e8d-a449-56633a7830e8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:40.459403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 589/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 17 20:02:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:42.347972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce619-5f15-466e-8a76-0581dcbd8275 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:42.348516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce619-5f15-466e-8a76-0581dcbd8275 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:42.348516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebce619-5f15-466e-8a76-0581dcbd8275 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:42.349856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 578/1167] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:42.354952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5775-1eb5-435a-8927-90848672f7e2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:42.355394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5775-1eb5-435a-8927-90848672f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:42.355497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d5775-1eb5-435a-8927-90848672f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:42.374206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c14d5775-1eb5-435a-8927-90848672f7e2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:42.375405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c14d5775-1eb5-435a-8927-90848672f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:42.441569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 590/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:42.710877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebce619-5f15-466e-8a76-0581dcbd8275 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:42.759123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:42.813568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebce619-5f15-466e-8a76-0581dcbd8275 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:42.847585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:42.848283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:42.848566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:42.848838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:42.849488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:42.850902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867830fc-9b9c-4412-ad44-8e69ea4dddc0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:42.913057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 579/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Wed Aug 17 20:02:42 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:44.868790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21353-77ad-436e-9c28-966f5e90c54d None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.869357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21353-77ad-436e-9c28-966f5e90c54d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.869357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a21353-77ad-436e-9c28-966f5e90c54d None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.870733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 591/1170] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:44.875917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:44.876344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:44.876456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:44.895721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:44.896933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:44.964651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 580/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:45.235741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21353-77ad-436e-9c28-966f5e90c54d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:45.262013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:45.337087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a21353-77ad-436e-9c28-966f5e90c54d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:45.371203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:45.371820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:45.372095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:45.372364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] PATH_INFO: `/v3/domains/d7058e794d9641d7a154523b3ddb7d2c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:45.382535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7058e794d9641d7a154523b3ddb7d2c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:45.383961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a443f-9de3-4cd2-91d4-a84e5eceef7a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:45.385547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 592/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Aug 17 20:02:45 2022] GET /identity/v3/domains/d7058e794d9641d7a154523b3ddb7d2c => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:45.391570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:45.426119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:45.491047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf342f8-2d82-4e83-a173-e336aa93f8ac None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:45.524100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:45.524708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:45.524984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:45.525251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:45.525900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:45.527348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778407e-2702-4feb-9050-ccf8985c7d2c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:45.607846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 581/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:02:45 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:02:47.553831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bc45-1877-4bf8-9adc-d86eaadbe5af None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.554388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bc45-1877-4bf8-9adc-d86eaadbe5af None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.554388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bc45-1877-4bf8-9adc-d86eaadbe5af None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.555669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 593/1174] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:47.560974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:47.561425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:47.561521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:47.579920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:47.581907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:47.647850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 582/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:47.919412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289bc45-1877-4bf8-9adc-d86eaadbe5af None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:48.008367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:48.024987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289bc45-1877-4bf8-9adc-d86eaadbe5af None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:48.060522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:48.061145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:48.061418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:48.061682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] PATH_INFO: `/v3/domains/d7058e794d9641d7a154523b3ddb7d2c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:48.062810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7058e794d9641d7a154523b3ddb7d2c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:48.064236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d309f-3bb4-446d-a249-73420da72d5c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:48.066837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 594/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Aug 17 20:02:47 2022] GET /identity/v3/domains/d7058e794d9641d7a154523b3ddb7d2c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:48.072859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:48.091675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:48.172580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4872d2-e33e-4e55-a816-ec51a8a48e5e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:48.211368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:48.211977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:48.212257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:48.212529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:48.213177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:48.214651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b7ea9-449e-4664-bee0-1d45c2209b9e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:48.317332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 583/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:02:48 2022] POST /identity/v3/users => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:02:50.277780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9f01-e6a1-45b1-b2aa-16f063fab3bc None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:50.278404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9f01-e6a1-45b1-b2aa-16f063fab3bc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:50.278404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e9f01-e6a1-45b1-b2aa-16f063fab3bc None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:50.279736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 595/1178] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:50.285763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:50.286247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:50.286339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:50.305707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:50.306938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:50.374101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 584/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:50.649901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e9f01-e6a1-45b1-b2aa-16f063fab3bc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:50.758765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e9f01-e6a1-45b1-b2aa-16f063fab3bc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:50.794272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:50.794895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:50.795168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:50.795433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:50.807030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:50.811676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:50.812762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:50.813815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 596/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:50.819180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:50.822278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:50.919938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f1204-f6a3-4cc8-9f25-2b04354da3c9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:50.953898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:50.954438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:50.954714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:50.955513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:50.956501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:50.956799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:50.958206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:50.966210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 585/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:50.972929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:50.988549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:51.076440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c530f-0da5-47e5-9ef9-02a9d95125e3 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:51.111433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:51.112057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:51.112339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:51.112632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] PATH_INFO: `/v3/users/a5426a69eeff401a8e176b5f2c7edc04` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:51.125741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] RBAC: Authorizing `identity:get_user(user_id=a5426a69eeff401a8e176b5f2c7edc04)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:51.127315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:51.128947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 597/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:50 2022] GET /identity/v3/users/a5426a69eeff401a8e176b5f2c7edc04 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:51.134908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:51.201843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:51.238242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f596e24-7c74-4e23-a5f2-b92ab98f24eb None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:51.272480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:51.273093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:51.273368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:51.273636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:51.342278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:51.343729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:51.407399 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:51.443476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 586/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:02:51.449478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:51.520288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:51.551715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b7ba-6b0e-4476-b089-ee3a99c50283 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:51.586601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:51.587293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:51.587577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:51.587853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] PATH_INFO: `/v3/projects/beae16af92d741b2a0a070d57c20f474` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:51.588964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] RBAC: Authorizing `identity:get_project(project_id=beae16af92d741b2a0a070d57c20f474)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:51.590456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ae2e3-02be-47ed-bc2f-b0845125de5d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:51.592193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 598/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:51 2022] GET /identity/v3/projects/beae16af92d741b2a0a070d57c20f474 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:51.598552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:51.701427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b945c-3d5b-4cac-814c-eee48cb8b63e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:51.739638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:51.740270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:51.740547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:51.740816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:51.741569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=beae16af92d741b2a0a070d57c20f474, user.id=a5426a69eeff401a8e176b5f2c7edc04) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:51.741909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:51.743392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898c6a3-cdac-4d87-b1b2-0a4a14f0103a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:51.749592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 587/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:51 2022] GET /identity/v3/role_assignments?user.id=a5426a69eeff401a8e176b5f2c7edc04&scope.project.id=beae16af92d741b2a0a070d57c20f474&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:53.677173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd0f3-4446-4c9e-9014-8a0bad7ffa16 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:53.677738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd0f3-4446-4c9e-9014-8a0bad7ffa16 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:53.677738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cd0f3-4446-4c9e-9014-8a0bad7ffa16 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:53.679072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 599/1186] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:53.684348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:53.684765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:53.684886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:53.702769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:53.703970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:53.727930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:53.772297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 588/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:02:54.043001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd0f3-4446-4c9e-9014-8a0bad7ffa16 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:54.145361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cd0f3-4446-4c9e-9014-8a0bad7ffa16 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:54.180921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:54.181543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:54.181817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:54.182142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:54.188782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:54.193145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:54.197959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:54.204990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:02:54.205847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 600/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:54.206690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:54.312732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a007d-ad71-4389-8723-c37735e44ba5 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:54.350074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:54.350687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:54.350970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:54.351246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:54.351909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:54.352245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:54.353632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:54.362402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 589/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:54.368336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:54.469288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1471bf-0aba-463b-af70-a87b2a8c6720 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:54.505232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:54.505858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:54.506172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:54.506443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] PATH_INFO: `/v3/users/a5426a69eeff401a8e176b5f2c7edc04` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:54.507550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] RBAC: Authorizing `identity:get_user(user_id=a5426a69eeff401a8e176b5f2c7edc04)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:54.509038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:54.510673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 601/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:54 2022] GET /identity/v3/users/a5426a69eeff401a8e176b5f2c7edc04 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:54.516469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:54.541785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:54.620718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a7eb-7cdc-4a38-97a3-6fd5d35f583a None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:54.654787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:54.655418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:54.655701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:54.656034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] PATH_INFO: `/v3/projects/beae16af92d741b2a0a070d57c20f474` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:54.657158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] RBAC: Authorizing `identity:get_project(project_id=beae16af92d741b2a0a070d57c20f474)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:54.659146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f081e2-a651-4d41-b665-eaff0fdac534 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:54.660814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 590/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:54 2022] GET /identity/v3/projects/beae16af92d741b2a0a070d57c20f474 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:54.667149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:54.735979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:54.769983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8f303-cc1a-4ee7-bc8e-87bc374ed775 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:54.804118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:54.804756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:54.805042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:54.805347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] PATH_INFO: `/v3/projects/beae16af92d741b2a0a070d57c20f474/users/a5426a69eeff401a8e176b5f2c7edc04/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:54.807240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] RBAC: Authorizing `identity:create_grant(project_id=beae16af92d741b2a0a070d57c20f474, user_id=a5426a69eeff401a8e176b5f2c7edc04, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:54.808652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7781-a056-40a7-8603-240840fdf466 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:54.902538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 602/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:02:54 2022] PUT /identity/v3/projects/beae16af92d741b2a0a070d57c20f474/users/a5426a69eeff401a8e176b5f2c7edc04/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:02:56.827364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108e59-80b4-4f35-b9d3-2988c7a9bcd0 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:56.827897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108e59-80b4-4f35-b9d3-2988c7a9bcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:56.827897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15108e59-80b4-4f35-b9d3-2988c7a9bcd0 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:56.829370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 591/1193] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:02:56.835564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:56.835997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:56.836117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:56.853993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:02:56.855194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:02:56.923737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 603/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:02:57.197080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15108e59-80b4-4f35-b9d3-2988c7a9bcd0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:57.289353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:57.300124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15108e59-80b4-4f35-b9d3-2988c7a9bcd0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:57.335709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:57.336349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:57.336628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:57.336900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:57.347941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:02:57.352642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:02:57.353611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:02:57.354714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 592/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:02:57.360254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:57.418231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:57.461616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0857166-e243-49ab-9917-3056e5d7ba8f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:57.502104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:57.502737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:57.503016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:57.503286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:57.503971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:57.504272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:57.505686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:57.515184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 604/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:02:57.521493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:57.628052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e780-5b0c-47d9-a75b-5c735fc0e200 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:57.662254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:57.662892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:57.663176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:57.663452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] PATH_INFO: `/v3/users/a5426a69eeff401a8e176b5f2c7edc04` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:57.664588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] RBAC: Authorizing `identity:get_user(user_id=a5426a69eeff401a8e176b5f2c7edc04)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:57.666075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:57.667691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 593/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 17 20:02:57 2022] GET /identity/v3/users/a5426a69eeff401a8e176b5f2c7edc04 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:57.674933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:57.774532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b983-1aa1-4cae-832d-26853c6deb02 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:57.792099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:57.808639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:57.809240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:57.809515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:57.809783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:57.878864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:57.880322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:57.978926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 605/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:02:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:02:57.985159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:58.004794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:58.086154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb23fb-db36-4d87-aaeb-a4d551133849 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:58.119831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:58.120457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:58.120736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:58.121006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] PATH_INFO: `/v3/projects/beae16af92d741b2a0a070d57c20f474` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:58.122140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=beae16af92d741b2a0a070d57c20f474)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:58.123579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2cb04-5588-424d-95d2-c3e6d3074ad0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:58.125213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 594/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 17 20:02:57 2022] GET /identity/v3/projects/beae16af92d741b2a0a070d57c20f474 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:02:58.131960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:02:58.152241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:02:58.243592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0c5b8-4e80-4746-bc64-d410fff68b4c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:02:58.281450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:02:58.282106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:02:58.282414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:02:58.282681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:02:58.283538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=beae16af92d741b2a0a070d57c20f474, user.id=a5426a69eeff401a8e176b5f2c7edc04) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:02:58.283848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:02:58.285295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf593a8-0473-4291-ba0d-3979865ebd9c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:02:58.291844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 606/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:02:58 2022] GET /identity/v3/role_assignments?user.id=a5426a69eeff401a8e176b5f2c7edc04&scope.project.id=beae16af92d741b2a0a070d57c20f474&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:03:08.115489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=57 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:03:08.288860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=59 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:19.461418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408e57-7e2d-4e56-b642-5be19bee0f19 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:19.462025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408e57-7e2d-4e56-b642-5be19bee0f19 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:19.462133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408e57-7e2d-4e56-b642-5be19bee0f19 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:19.463426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 595/1201] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:19.469577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:19.470053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:19.470153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:19.488160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:19.489332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:19.554676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 607/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:04:19.823713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50408e57-7e2d-4e56-b642-5be19bee0f19 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:19.927961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50408e57-7e2d-4e56-b642-5be19bee0f19 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:19.961907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:19.962545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:19.962872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:19.963133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:19.973941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:19.975445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:19.989903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:19.991298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:19.992452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:19.992452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:19.992452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:19.992452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 596/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:19.997600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:20.094478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae37ee-3a05-4a63-bfc7-638b9da69149 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:20.124047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:20.129708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:20.130343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.130615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.130882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.131513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:20.131887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:20.133247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eb65f-03cf-4e8c-abde-5cce45b06ae3 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:20.144547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 608/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:20.150559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:20.206644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:20.256325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fccfe-31a4-4940-9cac-60e62fa4ac87 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:20.290478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:20.291084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:20.291365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:20.291634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:20.292268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:20.294218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627544ab-2b22-4659-82b8-53a61b4c3064 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:20.416055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 597/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 17 20:04:20 2022] POST /identity/v3/users => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:04:22.375087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65616-8a32-41dd-b704-ba75a7993797 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.375645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65616-8a32-41dd-b704-ba75a7993797 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.375645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c65616-8a32-41dd-b704-ba75a7993797 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.377117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 609/1206] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:22.382496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.397115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.397115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.403450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:22.404661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:22.479109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 598/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:22.751180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c65616-8a32-41dd-b704-ba75a7993797 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.864155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c65616-8a32-41dd-b704-ba75a7993797 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:22.902688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:22.903382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:22.903658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:22.903924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:22.914434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:22.919603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:22.920846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:22.922206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 610/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:22.926754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:22.971150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:23.030213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359d6e0-c92e-4653-ba01-59ef1ac5ebcf None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.063888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.064495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.064789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.065033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.065729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:23.066051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.069316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:23.076531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 599/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:23.082907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:23.134530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:23.184335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e3035-407f-4e36-ab01-395d7f4ee1f1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.217989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.220748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.220748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.220748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.231221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.232713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:23.247986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:23.249095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:23.250387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:23.250387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:23.250387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:23.250387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 611/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:23.256556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:23.356038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fe267-0c12-416b-b9d4-f50d3fb3cdb5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.389034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.389674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.389978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.390189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.390803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:23.391100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.392458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:23.404308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 600/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:23.410088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:23.456160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:23.514640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b0e5b-27fd-43c7-9fb9-886189784bc8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.516137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:23.547174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.547789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.548066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.548325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.555458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.556888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:23.568515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:23.569674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:23.570703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 612/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:23.576335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:23.678817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fef40-668d-4ef6-9141-782c45b31441 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.713926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.714567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.714849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.715118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.715844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:23.716146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.717588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:23.734895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 601/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:23.740919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:23.843571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a576da1-8f46-4316-9f10-a1c2ae01046e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:23.878270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:23.878883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:23.879160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:23.879483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:23.911825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:23.949680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:23.951070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.046672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 613/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 20:04:24.052439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:24.071672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.150890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa788d-9855-44ec-b23d-3c7059bdf678 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:24.185789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:24.186450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.186725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.187046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.196931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:24.198505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:24.214828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:24.216840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:24.218007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:24.218007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:24.218007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:24.218007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 602/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:24.221079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:24.283914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.322759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d593e-36b3-4366-9fa5-58f0d7ce6be8 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:24.357699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:24.358398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.358681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.358956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.359608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:24.359910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:24.361284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.373196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 614/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:24.378969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:24.450393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.483343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1473ab8-59ff-40f8-8c09-7f9bc6dd3cdc None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:24.517458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:24.518126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.518410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.518682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.525346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:24.527401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:24.538671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:24.539837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:24.540986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 603/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:24.546349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:24.646515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491da79-fd89-459a-892e-0af38e44e644 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:24.670016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.681154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:24.681767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.682066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.682338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.683059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:24.683361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:24.684922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd7fe7-cf02-4ac0-9088-9a36a4a0b2d6 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.697429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 615/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:24.704564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:24.813989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b8ea-c747-4c47-aff2-9075195e2e09 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:24.843842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:24.850154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:24.850755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:24.851037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:24.851307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:24.852031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=7f4767886144473e95c3f3998461bd2b) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:24.852349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:24.853780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113017b-9ee3-4c9b-9514-b689e4dad369 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:24.860356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 604/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:24 2022] GET /identity/v3/role_assignments?user.id=7f4767886144473e95c3f3998461bd2b&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:26.777741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7639-73a4-4401-ac12-4389d93d0524 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.778320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7639-73a4-4401-ac12-4389d93d0524 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.778320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d7639-73a4-4401-ac12-4389d93d0524 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.779696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 616/1220] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:26.785260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:26.785706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:26.785798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:26.804591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:26.805907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:26.878238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 605/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:27.150869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7639-73a4-4401-ac12-4389d93d0524 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.257371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d7639-73a4-4401-ac12-4389d93d0524 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.297501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.298239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.298518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.298785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.310358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:27.315294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:27.316330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:27.317344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 617/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:27.323071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.433411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57576d0d-2987-4f01-9fc0-745618a5aef3 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.457709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:27.468850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.469536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.469820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.470121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.470867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] RBAC: Adding query filter params (name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:27.471171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.472812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.481309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 606/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:27.487547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.532044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:27.589753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a1485-f7a6-4b86-a4fd-8304a592bd06 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.625129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.625755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.626062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.626332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.637675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.639537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:27.656162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:27.657172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:27.658404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:27.658404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:27.658404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:27.658404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 618/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:27.663321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.765559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a338-9111-4cd4-8a0f-192bc7f17742 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.800360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.801041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.801223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.801484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.802152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:27.802450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.803868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.816232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 607/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:27.822373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:27.918063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:27.924626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a47de5-6318-40fa-93cc-f355b3b0862a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:27.957604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:27.958245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:27.958563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:27.958832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:27.967467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:27.968914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:27.982013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:27.983201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:27.984344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 619/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:27.989410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.037296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:28.090549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0101-0206-4fa2-ba79-c497a3893135 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.125148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.125760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.126065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.126337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.127053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:28.127351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.128771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:28.146424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 608/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:28.152481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.254160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1558b2-bb5a-4709-94b6-c0b302c53f8c None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.289283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.289822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.290130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.290405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.302080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.303529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:28.317895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:28.319114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:28.320145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:28.320145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:28.320145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:28.320145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 620/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:28.325559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.429333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f2949-2251-440e-aa77-05f1c07ffcec None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.431668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:28.464736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.465339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.465619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.465906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.466557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:28.466854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.468320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:28.479840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 609/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:28.485735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.495364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:28.585182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b47a3-a6f3-478d-b6f0-e61a40f38a90 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.619059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.619700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.620003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.620275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.627372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.628823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:28.640870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:28.642135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:28.643203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:28.646035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 621/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:28.648119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.753712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2204a05-b96e-4fa3-b22f-f63752119bc4 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.788612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.789213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.789489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.789757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.790471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:28.790833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.792960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1523eb3-49d6-4ae4-84df-742e7b2bf4d7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:28.806074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 610/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:28.812426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:28.879309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:28.913807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f85771-31f0-4186-9e13-4ef33fa584d1 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:28.948572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:28.949364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:28.949640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:28.949935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/7f4767886144473e95c3f3998461bd2b/roles/8163801c89814385a81e900eec97f5a4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:28.964747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=7f4767886144473e95c3f3998461bd2b, role_id=8163801c89814385a81e900eec97f5a4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:28.966571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c88ec-3100-4d21-a502-b308d1bc04ed None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:29.107368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 622/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:04:28 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/7f4767886144473e95c3f3998461bd2b/roles/8163801c89814385a81e900eec97f5a4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:04:31.044426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8af8-9c7e-431f-ac01-af7f495c8e38 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.044963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8af8-9c7e-431f-ac01-af7f495c8e38 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.045085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf8af8-9c7e-431f-ac01-af7f495c8e38 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.046375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 611/1233] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:31.052498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.053005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.053005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.075686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:31.077518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:31.164696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 623/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:31.443590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8af8-9c7e-431f-ac01-af7f495c8e38 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:31.473150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.552954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf8af8-9c7e-431f-ac01-af7f495c8e38 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.590733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.591374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.591655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.591926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.602860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:31.608427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:31.613584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:31.615300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 612/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 17 20:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:31.616238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:31.671922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.747274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72597cd-6b26-461b-9a14-8696f4f53a03 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.787227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.787867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.788149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.788423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.789161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] RBAC: Adding query filter params (name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:31.789468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:31.790995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:31.800001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 624/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 17 20:04:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:31.806082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:31.893851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:31.911120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9422cf-20b6-4ff9-ac4d-b0b6da7af7d2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:31.947651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:31.948281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:31.948562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:31.948879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:31.959724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:31.961215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:31.976589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:31.977766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:31.979461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:31.979461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:31.979461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:31.979461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 613/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:31.987397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:32.092012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7f7a5-0fd6-40f7-a9cb-99f8d9e5d80a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:32.101964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:32.127506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:32.128119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:32.128402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:32.128694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:32.129326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:32.129628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:32.131043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:32.142923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 625/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:32.149118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:32.251606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af854-1637-4e79-b62d-280cfe6d6447 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:32.286690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:32.287411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:32.287745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:32.288020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:32.290815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:32.296745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:32.298224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:32.309255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:32.314944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:32.316292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 614/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:32.317391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:32.425710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf081b-ef04-4115-bcef-a265441c9e6a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:32.459249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:32.459851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:32.460131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:32.460396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:32.461114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:32.461421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:32.462863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:32.481464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 626/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:32.487325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:32.591836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40676d11-5b97-45e0-8730-0f86c96a271d None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:32.626187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:32.626804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:32.627081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:32.627353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:32.691852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:32.699908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:32.701527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:32.803819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 615/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:32.810285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:32.837411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:32.909115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fb99f-7999-4092-beef-cbb58521338a None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:32.942568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:32.943117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:32.943390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:32.943652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:32.954309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:32.955806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:32.970910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:32.972322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:32.973548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:32.973548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:32.973548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:32.973548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 627/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:32.978102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:33.073736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:33.078962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a3b6a-3f8a-44e4-8df9-4627a39ff5b5 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:33.113793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:33.114426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.114703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.114971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.115613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:33.115914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:33.117292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:33.128503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 616/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:33.134296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:33.216629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:33.238942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae67ea9-9953-471b-b634-1c9f99d4864d None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:33.273048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:33.273673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.273973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.274248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.281727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:33.283252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:33.294598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:33.295704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:33.296650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 628/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:33.301730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:33.406193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b42b4-dd30-4889-b51c-de99c7d935c9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:33.441154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:33.441863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.442175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.442453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.443159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:33.443463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:33.444929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6370ac-845c-41e1-978e-f53ca9c80025 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:33.458406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 617/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:33.465375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:33.568493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ee7be-a055-4819-bfa6-079b92617232 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:33.604926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:33.605576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:33.605850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:33.606226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:33.606944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] RBAC: Adding query filter params (role.id=8163801c89814385a81e900eec97f5a4, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=7f4767886144473e95c3f3998461bd2b) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:33.607246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:33.608671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb412f6-5a00-42f9-8582-7a355bc98e69 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:33.614582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 629/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:33 2022] GET /identity/v3/role_assignments?user.id=7f4767886144473e95c3f3998461bd2b&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=8163801c89814385a81e900eec97f5a4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:35.612762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651ed3-3cfe-48e1-beab-ca0725a7d5a8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.613269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651ed3-3cfe-48e1-beab-ca0725a7d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.613269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af651ed3-3cfe-48e1-beab-ca0725a7d5a8 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.614597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 618/1247] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:35.621983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:35.622472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:35.622805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:35.629514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:35.642331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:35.644925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:35.710833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 630/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:35.985101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af651ed3-3cfe-48e1-beab-ca0725a7d5a8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.005183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:36.099677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af651ed3-3cfe-48e1-beab-ca0725a7d5a8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.140076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.140732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.141012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.141284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.153394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:36.158482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:36.159658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:36.160553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 619/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:36.166062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.274839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c4d56-220d-43d9-b26d-a5e85797dcd0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.305383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:36.310602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.311314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.311597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.313661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.314462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:36.314768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.316289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:36.325681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 631/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:36.331568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.413834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:36.436111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21757dc-1b9c-4e66-8bac-d70ea6f66ce3 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.473758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.474462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.474740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.475008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.488783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.490460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:36.505778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:36.507035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:36.508171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:36.508171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:36.508171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:36.508171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 620/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:36.513637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.618704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e649b-e915-4ca9-9193-2caa102c8973 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.651033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.651678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.651890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.652155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.652831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:36.653133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.654521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:36.667056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 632/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:36.672849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.776116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5fb60-cd73-4fef-95b4-02498cbe40d8 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.803733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:36.811255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.814338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.814338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.814338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.819918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.821375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:36.832139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:36.833518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:36.834969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 621/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:36.839813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:36.896113 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:36.941815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd8f93-af36-4c6e-811c-54f45db02e13 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:36.980928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:36.981537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:36.981818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:36.982120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:36.982852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:36.983157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:36.984623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.003148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 633/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:37.009319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:37.115708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc241a6c-87e7-4d6b-94e2-9fe975729911 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:37.149614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:37.150467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:37.150746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:37.151013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:37.211259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:37.224181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:37.225669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.326682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 622/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:37.332638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:37.434834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86974fb5-d681-4bfe-a368-6605c2387a51 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:37.449814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:37.470550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:37.471433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:37.471699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:37.471965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:37.482515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:37.484005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:37.499147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:37.500331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:37.501430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:37.501430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:37.501430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:37.501430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 634/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:37.506059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:37.594980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:37.607299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b52e1-6ae2-4870-97c9-09e01401c693 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:37.647216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:37.647830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:37.648113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:37.648384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:37.649025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:37.649328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:37.650841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.662343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 623/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:37.668455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:37.770260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad7787-acb8-4f2e-ac77-10df1c11869e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:37.803543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:37.806191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:37.806191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:37.806191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:37.812683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:37.814177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:37.825366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:37.826529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:37.827696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 635/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:37.832520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:37.935349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2db7e-f48f-456f-9cb4-7f55bb0e08af None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:37.969415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:37.970053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:37.970329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:37.970598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:37.971540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:37.971835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:37.973266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da27f7-044c-4e7a-9679-3d13571681a6 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:37.986597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 624/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:37.993007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:38.020715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:38.098556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe4ede-bed4-4d3f-8851-5337e4ecdf9e None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:38.133859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b396153-d419-474e-977b-cc31a313efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:38.134537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396153-d419-474e-977b-cc31a313efab None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:38.134818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396153-d419-474e-977b-cc31a313efab None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:38.135121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396153-d419-474e-977b-cc31a313efab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:38.135847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b396153-d419-474e-977b-cc31a313efab None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=7f4767886144473e95c3f3998461bd2b) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:38.136159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b396153-d419-474e-977b-cc31a313efab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:38.137587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b396153-d419-474e-977b-cc31a313efab None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:38.147725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 636/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:37 2022] GET /identity/v3/role_assignments?user.id=7f4767886144473e95c3f3998461bd2b&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:40.094466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f8cf-c9c3-4f93-9b6a-10cf00c05c0d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.095105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f8cf-c9c3-4f93-9b6a-10cf00c05c0d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.095105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f8cf-c9c3-4f93-9b6a-10cf00c05c0d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.096824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 625/1261] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:40.102151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.102597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.102733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.121917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:40.123155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:40.189414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 637/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 20:04:40.463508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f8cf-c9c3-4f93-9b6a-10cf00c05c0d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:40.474841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:40.565275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f8cf-c9c3-4f93-9b6a-10cf00c05c0d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:40.599067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:40.606885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.606885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.606885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.610842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:40.615625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:40.616737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:40.617637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 626/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:40.623218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:40.642124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:40.725655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926adc9-0e54-4503-a640-4517f1eb6f9c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:40.760364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:40.778655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:40.779292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 638/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:40.779386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:40.851069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:40.888622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd4154-b4ea-40cf-84cd-ac8682ab5cf2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:40.922276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:40.922861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:40.923138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:40.923403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:40.934015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:40.935458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:40.950213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:40.951410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:40.952553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:40.952553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:40.952553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:40.952553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 627/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:40.957328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.048220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.069366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07493a22-d868-4a4b-9c49-56f71aa29bc9 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.104264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.104920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.105129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.105396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.106065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:41.106362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.107731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.120178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 639/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:41.126120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.234150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af17b5-29fc-4b84-86ce-088cb11680a0 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.254870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.269456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.270133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.272251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.272251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.278801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.280252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:41.291579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:41.293171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:41.294355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 628/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:41.300002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.400407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a25af5-f238-4257-bca4-7392832ee54f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.435712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.436377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.436577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.436848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.437561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:41.437859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.439308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.451535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.461284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 640/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:41.467561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.579423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64fa4-b087-4b0f-b6e6-bd15292a5e05 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.616278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.617001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.617351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.621260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.630606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.632118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:41.647468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:41.648658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:41.650349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:41.650349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:41.650349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:41.650349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 629/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:41.655350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.754982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4d618-e5af-483e-a57b-d581b88ef8ae None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.791696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.792306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.792583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.792851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.793527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:41.793823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.795226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.806913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 641/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:41.812750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:41.846456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:41.914286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27ea78-1741-4e48-adbd-e4dd7db0d0b9 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:41.950055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:41.950690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:41.950967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:41.951233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:41.959022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:41.960568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:41.973615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:41.975546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:41.977316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 630/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:41.984150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:42.054527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:42.097778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1730c-3166-45c1-860b-e3ab3e969224 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:42.133012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:42.133793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:42.133936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:42.134193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:42.134891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:42.135193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:42.136622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eba086-a5aa-4ea1-8644-889582ad9a6e None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:42.148627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 642/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:42.156243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:42.247397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:42.255942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8169948-4ad5-47e5-a7d2-a404e1411d9e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:42.290172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:42.290839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:42.291206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:42.291483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] PATH_INFO: `/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/7f4767886144473e95c3f3998461bd2b/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:42.293501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f86ce3fe6d649e59db94f90679f6101, user_id=7f4767886144473e95c3f3998461bd2b, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:42.294986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f08bf-2c3e-4b67-b6cf-7f5dc766b8c0 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:42.404324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 631/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 17 20:04:42 2022] PUT /identity/v3/projects/9f86ce3fe6d649e59db94f90679f6101/users/7f4767886144473e95c3f3998461bd2b/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:04:44.323137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b9cf-4b3e-487f-be3f-2b8a8aa1c8fe None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.323665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b9cf-4b3e-487f-be3f-2b8a8aa1c8fe None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.323665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b9cf-4b3e-487f-be3f-2b8a8aa1c8fe None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.325022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 643/1274] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:44.330755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd649-0550-484c-a087-46cb38d39ece None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.334338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd649-0550-484c-a087-46cb38d39ece None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.334338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd649-0550-484c-a087-46cb38d39ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.350499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-235fd649-0550-484c-a087-46cb38d39ece None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:44.351692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-235fd649-0550-484c-a087-46cb38d39ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:44.422119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 632/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:44.700615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083b9cf-4b3e-487f-be3f-2b8a8aa1c8fe None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:44.806292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083b9cf-4b3e-487f-be3f-2b8a8aa1c8fe None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:44.823818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:44.841024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:44.841720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:44.842036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:44.842302 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:44.853067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 20:04:44.857850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:44.859009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:44.859972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 644/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 17 20:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:44.865158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd649-0550-484c-a087-46cb38d39ece None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:44.949418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:44.967790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd649-0550-484c-a087-46cb38d39ece None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.002038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.002644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.002923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.003274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.003938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:45.004239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.005614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.014002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 633/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 17 20:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:45.020082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:45.126828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98707e9c-7921-4d20-a2fa-4c0bb7c58d0f None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.160777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.161391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.161665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.161973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.172201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.173610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:45.188419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:45.192894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:45.194054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:45.194054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:45.194054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:45.194054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 645/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:45.195714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:45.298749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afc17e-16a0-491d-b30e-6a8a7bd28d84 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.332611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.333270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.333476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.333743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.334404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:45.334700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.336060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.348076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 634/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:45.354631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:45.385988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:45.458552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db6f1-030a-424e-807b-85848743ccfd None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.492937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.493656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.493958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.494228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.501664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.503132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 20:04:45.515163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:45.518638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:45.526703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 646/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:45.527626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:45.527626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:45.627761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5292-aa27-4825-98f7-01f29c51aa31 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.664205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.664849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.665256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.665526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.666314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:45.666621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.668115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.685532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 635/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 17 20:04:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:45.691420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:45.786707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:45.797202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2885-97f7-4569-9d0f-535552e62958 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:45.830899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:45.831533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:45.831812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:45.832081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:45.902942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:45.904396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:45.994576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:46.004906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 647/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 17 20:04:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 20:04:46.011758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.075037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:46.113865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc05bd9-afb9-4cdb-ad0b-86e81e438e7c None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.148027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.148655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.148981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.149825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.160070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.161526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 20:04:46.176736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:46.178326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 20:04:46.179501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 20:04:46.179501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 20:04:46.179501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:46.179501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 636/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:46.184090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.288792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aab5cb-e701-4e26-b436-dac4e68f04a7 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.324698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.325368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.325589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.325928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.326595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:46.326876 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.328255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.340457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 648/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:46.346558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.462023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b464e-4105-4953-8f70-724dd66e78d2 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.476298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:46.496995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.497635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.497936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.498211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.504784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.506273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 20:04:46.518085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:46.519133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: ERROR keystone.server.flask.application Aug 17 20:04:46.520139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 637/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:46.525416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.576335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:46.628210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04ab0e-d36b-4201-8295-c825dcd535df None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.661310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.661917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.662230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.662498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.663173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:46.663470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.665044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f2187-1327-4443-9f22-e5e90ada3567 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.677422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 649/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:04:46.689627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:46.791608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ae14a-1c92-48e2-9cc4-01b9a1d22907 None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:46.825967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:46.826625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:46.826844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:46.827111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:46.827823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] RBAC: Adding query filter params (role.id=a1c119f687024f64a94dba8ff8849b9b, scope.project.id=9f86ce3fe6d649e59db94f90679f6101, user.id=7f4767886144473e95c3f3998461bd2b) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:46.828127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:46.829633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805fe4d-b417-4778-acb9-24e77a921ba4 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:46.835372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 638/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 17 20:04:46 2022] GET /identity/v3/role_assignments?user.id=7f4767886144473e95c3f3998461bd2b&scope.project.id=9f86ce3fe6d649e59db94f90679f6101&role.id=a1c119f687024f64a94dba8ff8849b9b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:48.790049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2d3e-b004-4688-bd10-b6e9c3b089e9 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:48.790611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2d3e-b004-4688-bd10-b6e9c3b089e9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:48.790611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a2d3e-b004-4688-bd10-b6e9c3b089e9 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:48.792088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 650/1288] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:48.797322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:48.800510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:48.800510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:48.816297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:48.817481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:48.847475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:48.884446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 639/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:49.163059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2d3e-b004-4688-bd10-b6e9c3b089e9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:49.275994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a2d3e-b004-4688-bd10-b6e9c3b089e9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:49.288533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:49.315399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:49.316033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:49.321990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:49.321990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:49.321990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:49.321990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:49.328203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:49.329514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:49.330541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 651/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:49.335749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:49.440008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba3de3-e39b-4bb5-8fb2-8d0266f7b1cd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:49.480597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:49.481235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:49.481501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:49.481778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:49.482450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:49.482755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:49.484219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5f3b1-9696-4b99-a07e-9ab37b79e2c7 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:49.489536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 640/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:49.495589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:49.596682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d610d5a-8fce-4061-857b-6e58b497c390 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:49.632297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:49.632921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:49.633217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:49.633491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] PATH_INFO: `/v3/services` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:49.634194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:49.634518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:49.635839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cdade-39f0-4e4e-9193-944f55635899 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:49.640964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 652/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:51.563485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ac82-b4eb-4237-8b73-c065a9684d4b None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:51.564009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ac82-b4eb-4237-8b73-c065a9684d4b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:51.564009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154ac82-b4eb-4237-8b73-c065a9684d4b None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:51.565331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 641/1293] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:51.571271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa63f-eb41-4e7d-8c4b-eaf0d303b42a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:51.571694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa63f-eb41-4e7d-8c4b-eaf0d303b42a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:51.571920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa63f-eb41-4e7d-8c4b-eaf0d303b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:51.591011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-85dfa63f-eb41-4e7d-8c4b-eaf0d303b42a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:51.595685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-85dfa63f-eb41-4e7d-8c4b-eaf0d303b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:51.624164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:51.662240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 653/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:51.938045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ac82-b4eb-4237-8b73-c065a9684d4b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:51.970788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:52.038749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154ac82-b4eb-4237-8b73-c065a9684d4b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:52.072313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:52.072908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:52.073183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:52.073458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:52.074143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:52.075507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e31616-d8c7-4baf-91dd-5854ac5aa406 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:52.197990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 642/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 17 20:04:51 2022] POST /identity/v3/services => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:04:54.152833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124501-2df3-4bcd-9fa3-79f4e0e4133c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:54.153439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124501-2df3-4bcd-9fa3-79f4e0e4133c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:54.153439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f124501-2df3-4bcd-9fa3-79f4e0e4133c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:54.154896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 654/1296] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:54.160371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:54.160790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:54.160910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:54.180034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:54.181333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:54.255534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 643/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:54.531244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f124501-2df3-4bcd-9fa3-79f4e0e4133c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:54.633635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f124501-2df3-4bcd-9fa3-79f4e0e4133c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:54.667172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:54.667791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:54.668095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:54.668359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:54.668922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:54.670309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:54.678632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:54.680338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:54.681460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 655/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:54.686890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:54.705260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:54.788159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebcfb4-294a-417a-af1a-21ccfb96e5ce None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:54.822811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:54.823407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:54.823684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:54.823954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:54.824576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:54.824875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:54.826270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:54.831220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 644/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:54.837495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:54.876436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:54.949147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45babf5c-1df9-44ee-aab2-db06526d4794 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:54.983179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:54.983778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:54.984059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:54.984329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:54.985024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] RBAC: Adding query filter params (interface=public, service_id=4e723529a19d460dbe6ec6cd34682211, region_id=RegionOne) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:54.985327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:54.986720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d1141-aa3f-4f9a-a533-1978c2dac121 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:54.991669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 656/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 17 20:04:54 2022] GET /identity/v3/endpoints?service_id=4e723529a19d460dbe6ec6cd34682211&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:54.997919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:55.082925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:55.101020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a290-53dc-4861-b6f0-c47ca6a9d16e None admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:55.136009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:55.136638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:55.136947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:55.137221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:55.137851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:55.139254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ec595-6568-431c-b74f-7d7bee80be47 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:55.146074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 645/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 17 20:04:54 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:04:57.042628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf19c5-9352-4360-b79a-c2648ae962d1 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:57.043191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf19c5-9352-4360-b79a-c2648ae962d1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:57.043191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf19c5-9352-4360-b79a-c2648ae962d1 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:57.044507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 657/1302] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:04:57.049810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:57.050249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:57.050443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:57.068222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:04:57.069404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:04:57.138353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 646/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:04:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 20:04:57.413236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf19c5-9352-4360-b79a-c2648ae962d1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:57.513768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:57.520229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf19c5-9352-4360-b79a-c2648ae962d1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:57.553830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:57.554608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:57.554886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:57.555442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:57.555789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:57.557159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 20:04:57.566161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 20:04:57.567353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application with Lock( Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self._enter() Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application return self.creator() Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application created_value = creator( Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: ERROR keystone.server.flask.application Aug 17 20:04:57.568361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 658/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 17 20:04:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 20:04:57.573852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:57.659512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:04:57.682390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa9d49-9a6d-4c8b-a2cb-83b1bf800f42 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:57.716472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:57.717079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:57.717378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:57.717645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] PATH_INFO: `/v3/services` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:57.718303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:04:57.718602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:57.720222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78b95-e2c5-4413-ac03-31833bf0be82 None admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:57.725304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 647/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 17 20:04:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:04:57.731934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:04:57.832961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aa6ed-029c-41ce-9949-eda7a7ac7e18 None admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:04:57.870091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:04:57.870695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:04:57.870971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:04:57.871236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:04:57.871880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:04:57.873231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5fc6f-0b3e-4966-930e-ec9bab69197c None admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:04:58.065975 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 659/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:04:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:05:07.812522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=30 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:05:08.060189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:47.270877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3855a-e12b-4eef-afc4-6c031a486b70 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:47.271441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3855a-e12b-4eef-afc4-6c031a486b70 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:47.271441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3855a-e12b-4eef-afc4-6c031a486b70 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:47.278918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907e24-d5d4-4a03-9089-fa3cf6f1b071 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:47.279772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907e24-d5d4-4a03-9089-fa3cf6f1b071 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:47.280208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3907e24-d5d4-4a03-9089-fa3cf6f1b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:47.283042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 648/1307] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:12:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:47.413281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d3907e24-d5d4-4a03-9089-fa3cf6f1b071 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:47.415640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d3907e24-d5d4-4a03-9089-fa3cf6f1b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:47.588784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 660/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:12:47.899803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:47.901110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:47.901713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:47.903228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 649/1309] 10.222.0.48 () {54 vars in 965 bytes} [Wed Aug 17 20:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:47.910867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23d0d-33d5-4b87-91f9-4761ca54ad25 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:47.911468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23d0d-33d5-4b87-91f9-4761ca54ad25 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:47.911950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b23d0d-33d5-4b87-91f9-4761ca54ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:48.003990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a7b23d0d-33d5-4b87-91f9-4761ca54ad25 None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:48.005506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a7b23d0d-33d5-4b87-91f9-4761ca54ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:48.030993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:48.101743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 661/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Aug 17 20:12:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:12:48.111395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:48.113396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:48.250117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ae67-6b8c-4b92-b5b2-92dc3122f03d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:48.352631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:48.354201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:48.354201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:48.354496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:48.356198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:48.437492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:48.486036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:48.487589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94b46-3f16-4b6c-90c4-49f05bb04398 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:48.511364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 650/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:50.847492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:50.848045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:50.848045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:50.849566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 662/1312] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:50.855290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42cfe-60c5-47c5-b4aa-c6f4162ee48d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:50.855832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42cfe-60c5-47c5-b4aa-c6f4162ee48d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:50.855832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df42cfe-60c5-47c5-b4aa-c6f4162ee48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:50.938166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1df42cfe-60c5-47c5-b4aa-c6f4162ee48d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:50.939406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1df42cfe-60c5-47c5-b4aa-c6f4162ee48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:51.068530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 651/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:51.359872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:51.361477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:51.475379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b15a-2e72-4697-b967-94498793bc15 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:51.552871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:51.555533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:51.557335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:51.557630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:51.557998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:51.559652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:51.672293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:51.673666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb4acf-fe83-4750-b116-a4b91fe2860b service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:51.692233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 663/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:12:54.216446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:54.217058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:54.217058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:54.218393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 652/1315] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:54.225019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0608e-b810-4c76-9c03-14f07232f2b8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:54.225568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0608e-b810-4c76-9c03-14f07232f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:54.225568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0608e-b810-4c76-9c03-14f07232f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:54.301756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-64a0608e-b810-4c76-9c03-14f07232f2b8 None None] MFA Rules not processed for user `e3a5432fcc7e499a908cd3704cc3a622`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:54.303036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-64a0608e-b810-4c76-9c03-14f07232f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:54.360869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:54.406854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 664/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:54.697132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:54.698780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:54.709136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:54.823291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab6318-899f-4ab1-9d96-1a9a1d24cd96 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:54.900130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:54.900803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:54.901082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:54.901349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:54.902993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:54.966266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:55.016493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:55.017969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9b13a-df65-421a-998b-bb90472751ac service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:55.039680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 653/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:12:57.954130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1235-ce97-416b-bcfc-20f3432f5955 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:57.954701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1235-ce97-416b-bcfc-20f3432f5955 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:57.954701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb1235-ce97-416b-bcfc-20f3432f5955 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:57.956021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 665/1318] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:57.961393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5855-fe9b-4d44-a66b-eb2e845e5e55 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:57.961892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5855-fe9b-4d44-a66b-eb2e845e5e55 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:57.962360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b5855-fe9b-4d44-a66b-eb2e845e5e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.029667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-928b5855-fe9b-4d44-a66b-eb2e845e5e55 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:58.030954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-928b5855-fe9b-4d44-a66b-eb2e845e5e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.131151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 654/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:58.438812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.439100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.439373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.440722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 666/1320] 10.222.0.48 () {54 vars in 965 bytes} [Wed Aug 17 20:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:12:58.447258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff928fd-2e85-4b3c-930a-a2bdf7181ada None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.447588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff928fd-2e85-4b3c-930a-a2bdf7181ada None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.447902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff928fd-2e85-4b3c-930a-a2bdf7181ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.470816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:58.526899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5ff928fd-2e85-4b3c-930a-a2bdf7181ada None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:12:58.528043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5ff928fd-2e85-4b3c-930a-a2bdf7181ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.606428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 655/1321] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Aug 17 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:12:58.615539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:12:58.617084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.723250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416b7e-8c98-4c66-9fd6-c4247d40c6d9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:12:58.797266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:12:58.797788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:12:58.798119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:12:58.798364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:12:58.799991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:12:58.808086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:12:58.913255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:12:58.914818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc136f-f1e2-4ad2-85a5-985bb508f99d service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:12:58.933586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 667/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:12:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:02.405634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:02.406211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:02.406211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:02.407554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 656/1323] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:02.413657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b45a8d-954c-4b52-8fbe-bdcd6e9b15d2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:02.414309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b45a8d-954c-4b52-8fbe-bdcd6e9b15d2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:02.414552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b45a8d-954c-4b52-8fbe-bdcd6e9b15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:02.493352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f1b45a8d-954c-4b52-8fbe-bdcd6e9b15d2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:02.494558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f1b45a8d-954c-4b52-8fbe-bdcd6e9b15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:02.560050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:02.603673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 668/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:02.891077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:02.892779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:03.018596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f202d-1ab8-4c01-9fd4-9d77c1232a9c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:03.035182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:03.105487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:03.106125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:03.106407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:03.106671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:03.108351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:03.223970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:03.225429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22823-8d33-4acb-b9ee-61984102497a service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:03.244923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 657/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:05.293945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:05.294481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:05.294481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:05.296125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 669/1326] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:05.301743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7abc5-7375-477a-8aea-393435724811 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:05.302253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7abc5-7375-477a-8aea-393435724811 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:05.302379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7abc5-7375-477a-8aea-393435724811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:05.357436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:05.377671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2bc7abc5-7375-477a-8aea-393435724811 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:05.378936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2bc7abc5-7375-477a-8aea-393435724811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:05.488911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 658/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:05.775192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:05.776828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:05.890018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34776b6-fe47-4c00-a287-23fb43e15954 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:05.970107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:05.970639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:05.970914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:05.971177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:05.972829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:06.000442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:06.104760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:06.106258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343849c1-4d57-457c-8f64-42113f4e5bd0 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:06.125668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 670/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:08.253420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:08.254079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:08.254079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:08.255379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 659/1329] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:08.261867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c513-a625-4d68-a33e-dda2fff558b4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:08.262470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c513-a625-4d68-a33e-dda2fff558b4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:08.262609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c513-a625-4d68-a33e-dda2fff558b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:08.338233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b889c513-a625-4d68-a33e-dda2fff558b4 None None] MFA Rules not processed for user `e3a5432fcc7e499a908cd3704cc3a622`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:08.339459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b889c513-a625-4d68-a33e-dda2fff558b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:08.410870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:08.449846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 671/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:08.730463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:08.732079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:08.870175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b4685-e514-4b7b-9aac-924f5584e40b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:08.893300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:08.952752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:08.953364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:08.953643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:08.953954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:08.955599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:09.100058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:09.102126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508638e-854d-4584-88d4-69baac5962e6 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:09.124729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 660/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:11.641394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:11.642054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:11.642054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:11.643220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 672/1332] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:11.649941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4c84-154e-45b2-9193-232c11bd5f34 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:11.650513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4c84-154e-45b2-9193-232c11bd5f34 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:11.650513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4c84-154e-45b2-9193-232c11bd5f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:11.721746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:11.724742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5eeb4c84-154e-45b2-9193-232c11bd5f34 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:11.726078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5eeb4c84-154e-45b2-9193-232c11bd5f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:11.846773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 661/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:12.130023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:12.131612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:12.239244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e43d49-d981-46a0-b68d-95cb4822448f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:12.317918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:12.318520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:12.318795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:12.319067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:12.321296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:12.350856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:12.435937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:12.437375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d92d0-3f30-4760-88a2-44497d7cb84c service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:12.457030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 673/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:14.461708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:14.462308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:14.462308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:14.463665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 662/1335] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:14.469766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4467d0-4081-4d84-b9dc-6fed02d9f1e0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:14.470384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4467d0-4081-4d84-b9dc-6fed02d9f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:14.470384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4467d0-4081-4d84-b9dc-6fed02d9f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:14.548661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fa4467d0-4081-4d84-b9dc-6fed02d9f1e0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:14.549832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fa4467d0-4081-4d84-b9dc-6fed02d9f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:14.636895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:14.663282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 674/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:14.950938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:14.952480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:15.061014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c8a9f-c2d0-431f-95e0-90b39a3223b6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:15.089936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:15.138770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:15.139396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:15.139674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:15.139946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:15.141700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:15.265616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:15.267125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216099-3f54-437e-b180-5da8b22bce49 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:15.289870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 663/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:17.991332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:17.991876 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:17.991876 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:17.993275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 675/1338] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:17.999488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec57bf-eed2-4d56-bd0a-1460415b5606 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:18.000017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec57bf-eed2-4d56-bd0a-1460415b5606 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:18.000017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec57bf-eed2-4d56-bd0a-1460415b5606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:18.084926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7eec57bf-eed2-4d56-bd0a-1460415b5606 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:18.086202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7eec57bf-eed2-4d56-bd0a-1460415b5606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:18.094955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:18.199270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 664/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:18.480313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:18.481904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:18.598151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dc6ff-cc9e-4570-9d3d-580195283382 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:18.676883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:18.677493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:18.677767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:18.678822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:18.680577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:18.719331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:18.798067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:18.799657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6e997-98aa-4fbd-a4ed-df0391eebd1b service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:18.820877 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 676/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:23.096673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:23.097424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:23.097424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:23.099140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 665/1341] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:23.104491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f27b-0bd9-422e-867e-d38967e9fefc None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:23.105254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f27b-0bd9-422e-867e-d38967e9fefc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:23.105254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f27b-0bd9-422e-867e-d38967e9fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:23.197406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e497f27b-0bd9-422e-867e-d38967e9fefc None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:23.199459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e497f27b-0bd9-422e-867e-d38967e9fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:23.315509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:23.328669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 677/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:23.627636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:23.629447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:23.795543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442afc31-1880-4c01-bbb7-64a94d735b03 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:23.846565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:23.902773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:23.903676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:23.903997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:23.904311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:23.906374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:24.036849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:24.038786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc0f46-dcd2-4c90-9427-66eabb741446 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:24.061410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 666/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:27.742228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:27.742774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:27.742962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:27.744530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 678/1344] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:27.750947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66ecda-4f69-437f-9b5d-14a7c380a603 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:27.751550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66ecda-4f69-437f-9b5d-14a7c380a603 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:27.751550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66ecda-4f69-437f-9b5d-14a7c380a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:27.829601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3f66ecda-4f69-437f-9b5d-14a7c380a603 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:27.830864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3f66ecda-4f69-437f-9b5d-14a7c380a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:27.851159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:27.939995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 667/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:28.235169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:28.236755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:28.351928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fa649-4f83-4696-9da0-70b0f84d80c4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:28.472385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:28.473133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:28.473481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:28.473900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:28.475716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:28.530904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:28.613340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:28.614951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a201c73-e372-4103-a06d-7134754b4e7d service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:28.639393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 679/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:33.612421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:33.612968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:33.612968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:33.615281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 668/1347] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:33.621900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedb9e-ca52-4ebe-a7f0-84e51577e041 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:33.622451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedb9e-ca52-4ebe-a7f0-84e51577e041 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:33.622451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cedb9e-ca52-4ebe-a7f0-84e51577e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:33.708183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-74cedb9e-ca52-4ebe-a7f0-84e51577e041 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:33.709564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74cedb9e-ca52-4ebe-a7f0-84e51577e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:33.819559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:33.822592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 680/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:34.113704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:34.115260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:34.232616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4404e-dac5-4d10-9163-bc4c1352493d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:34.284292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:34.313252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:34.313777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:34.314160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:34.314436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:34.317872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:34.447605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:34.449066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b4ae5-badc-4e07-a4a9-b022933ef24f service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:34.468905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 669/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:39.924377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4346e8-9236-4031-b5ee-c0d9d58390d2 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:39.924928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4346e8-9236-4031-b5ee-c0d9d58390d2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:39.924928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4346e8-9236-4031-b5ee-c0d9d58390d2 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:39.926821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 681/1350] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:39.932576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd651-5fe2-4cdf-a8af-b9e1811c6144 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:39.933855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd651-5fe2-4cdf-a8af-b9e1811c6144 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:39.934375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfd651-5fe2-4cdf-a8af-b9e1811c6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:40.063297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-15cfd651-5fe2-4cdf-a8af-b9e1811c6144 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:40.064774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-15cfd651-5fe2-4cdf-a8af-b9e1811c6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:40.091379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.212401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 670/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:45.726522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377dba-6297-4200-aafc-6a2d04403502 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:45.727314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377dba-6297-4200-aafc-6a2d04403502 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:45.727314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9377dba-6297-4200-aafc-6a2d04403502 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:45.728732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 682/1352] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:13:45.735345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59842d-6a0a-494d-bf96-66f4ea4ae97d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:45.736064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59842d-6a0a-494d-bf96-66f4ea4ae97d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:45.736680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59842d-6a0a-494d-bf96-66f4ea4ae97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:45.850452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8c59842d-6a0a-494d-bf96-66f4ea4ae97d None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:45.851856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8c59842d-6a0a-494d-bf96-66f4ea4ae97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:45.959120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:46.016309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 671/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:47.584255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23861-b88d-4be4-a34d-de3973a8f0ba None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:47.584998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23861-b88d-4be4-a34d-de3973a8f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:47.584998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23861-b88d-4be4-a34d-de3973a8f0ba None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:47.587171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 683/1354] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:47.592831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dda4d-e68c-4d82-8563-93a56b9b55cc None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:47.593459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dda4d-e68c-4d82-8563-93a56b9b55cc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:47.593459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dda4d-e68c-4d82-8563-93a56b9b55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:47.685256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a91dda4d-e68c-4d82-8563-93a56b9b55cc None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:47.686502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a91dda4d-e68c-4d82-8563-93a56b9b55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:47.826826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 672/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:51.446651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e328-b53d-42bc-b800-caaff5c1c8ea None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:51.447526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e328-b53d-42bc-b800-caaff5c1c8ea None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:51.447970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98e328-b53d-42bc-b800-caaff5c1c8ea None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:51.449426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 684/1356] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:51.458152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3cbc-5c9d-4ac5-becb-0b9d96811c81 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:51.459371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3cbc-5c9d-4ac5-becb-0b9d96811c81 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:51.459371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3cbc-5c9d-4ac5-becb-0b9d96811c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:51.528526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:51.585145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2d4e3cbc-5c9d-4ac5-becb-0b9d96811c81 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:51.586858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2d4e3cbc-5c9d-4ac5-becb-0b9d96811c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:51.715365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 673/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:52.028115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:52.028724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:52.029217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:52.030870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 685/1358] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 17 20:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:52.039515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7307-6877-4a4e-9ab3-79d2e1b17567 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:52.039950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7307-6877-4a4e-9ab3-79d2e1b17567 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:52.040337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a7307-6877-4a4e-9ab3-79d2e1b17567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:52.144581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6f7a7307-6877-4a4e-9ab3-79d2e1b17567 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:52.145982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6f7a7307-6877-4a4e-9ab3-79d2e1b17567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:52.207879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:52.321998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 674/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 17 20:13:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:52.336746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:52.339813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:52.531320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418fcc2-fc71-4acd-a02d-b5aa33064a25 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:52.627601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:52.709822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:52.710680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:52.711162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:52.711637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:52.713446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:52.837057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:52.838756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440fa7e-70c2-41d8-9578-179c8e23bea0 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:52.861862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 686/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:55.521245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:55.521245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:55.521245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:55.521245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 675/1361] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:55.527236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49bdc-df56-4200-bb48-2fda227d6f91 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:55.527910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49bdc-df56-4200-bb48-2fda227d6f91 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:55.527910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d49bdc-df56-4200-bb48-2fda227d6f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:55.610603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-27d49bdc-df56-4200-bb48-2fda227d6f91 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:55.612409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-27d49bdc-df56-4200-bb48-2fda227d6f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:55.663002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:55.734976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 687/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:56.042195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:56.043894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:56.311003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdb3e-3b5a-48ae-9297-3f407b5f4b3a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:56.324510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:56.442099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:13:56.442737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:56.443019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:56.443297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:56.445078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:56.558889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:13:56.563549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29986-6288-4094-af1d-c191e123b28d service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:13:56.582470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 676/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:13:58.995571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143c71-1d1a-4422-ac5b-ca24f15e48c8 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:58.996143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143c71-1d1a-4422-ac5b-ca24f15e48c8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:58.996143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143c71-1d1a-4422-ac5b-ca24f15e48c8 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:58.997452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 688/1364] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:59.003873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341166c9-0683-45bf-b068-68f1f0dadb0a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:59.004386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341166c9-0683-45bf-b068-68f1f0dadb0a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:59.004386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341166c9-0683-45bf-b068-68f1f0dadb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:59.020785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:59.079875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-341166c9-0683-45bf-b068-68f1f0dadb0a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:59.081129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-341166c9-0683-45bf-b068-68f1f0dadb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:59.188441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 677/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:13:59.484542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:59.484824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:59.485279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:59.487942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 689/1366] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 17 20:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:13:59.494020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c08-69e7-44d0-a143-696f6819a335 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:13:59.494536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c08-69e7-44d0-a143-696f6819a335 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:13:59.494973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b9c08-69e7-44d0-a143-696f6819a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:13:59.581999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-945b9c08-69e7-44d0-a143-696f6819a335 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:13:59.583360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-945b9c08-69e7-44d0-a143-696f6819a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:59.621262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:59.721101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 678/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 17 20:13:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:13:59.729518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:13:59.731181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:13:59.909687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b11dd5-dccb-4055-8cab-8c8e45275059 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:13:59.938677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:00.083479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:00.085057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:00.085535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:00.086034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:00.087931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:00.205173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:00.207355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3b1cd-4084-49b1-beff-cde45e64cd96 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:00.230570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 690/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:01.423554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fa75-4826-4ce2-98b9-ecbbd75ff001 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:01.424330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fa75-4826-4ce2-98b9-ecbbd75ff001 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:01.425092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fa75-4826-4ce2-98b9-ecbbd75ff001 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:01.429935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 679/1369] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:01.432950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01ed8-b947-44a6-9b5a-9062f1ba29e4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:01.433500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01ed8-b947-44a6-9b5a-9062f1ba29e4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:01.433736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f01ed8-b947-44a6-9b5a-9062f1ba29e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:01.481405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:01.540428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a4f01ed8-b947-44a6-9b5a-9062f1ba29e4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:01.541557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a4f01ed8-b947-44a6-9b5a-9062f1ba29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:01.684702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 691/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:02.254858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7692-5062-4dab-9574-e87616a8c9e3 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.255345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7692-5062-4dab-9574-e87616a8c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.255744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7692-5062-4dab-9574-e87616a8c9e3 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.257331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 680/1371] 10.222.0.48 () {54 vars in 964 bytes} [Wed Aug 17 20:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:02.263666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.263949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.264223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.352531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] MFA Rules not processed for user `af188d89b2fe416884b5f80ff25b8d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:02.353760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:02.420549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:02.460310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 692/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Aug 17 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:02.465811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee3-84c5-4f95-a9be-b99de694e082 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.466377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee3-84c5-4f95-a9be-b99de694e082 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.466377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2ee3-84c5-4f95-a9be-b99de694e082 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.467764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 681/1373] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:02.468014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:02.474117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.474403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.474679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.476904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7077e4e-5309-40cd-8727-37e2578fd948 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:02.557602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:02.558780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:02.565870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:02.566522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:02.566804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:02.567082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:02.568795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:02.658698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:02.667294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 682/1374] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:02.710602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:02.712054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7e0a3-884c-45b1-b8b7-d86232c8af28 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:02.723715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:02.731914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 693/1375] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:02.963429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:02.964829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:03.094412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683abb9-546c-436e-8436-cf886ecf7cff None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:03.211259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:03.224434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:03.225055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:03.225363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:03.225663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:03.227340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:03.330327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:03.331946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a561-bfb2-49a1-ba7e-7e2331b20032 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:03.352400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 683/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:05.613755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.614433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.614433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.615679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 694/1377] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:05.622010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7eac-efc6-4158-a71b-96e8bfabd767 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:05.622535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7eac-efc6-4158-a71b-96e8bfabd767 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:05.622535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb7eac-efc6-4158-a71b-96e8bfabd767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:05.716015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-73eb7eac-efc6-4158-a71b-96e8bfabd767 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:05.717249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-73eb7eac-efc6-4158-a71b-96e8bfabd767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:05.791413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:05.830820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 684/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:06.143832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:06.145730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:06.346607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02418-6571-4e1f-9fe9-dec771212d70 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:06.434555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:06.494390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:06.495134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:06.495492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:06.495831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:06.498604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:06.671290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:06.675163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c911e-24dc-4f79-be47-7cdd4c894837 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:06.721614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 695/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:09.050383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:09.051277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:09.051277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:09.053432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 685/1380] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:09.060396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8260-c67d-489d-a7cf-e75e5e2654fe None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:09.060982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8260-c67d-489d-a7cf-e75e5e2654fe None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:09.061302 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8260-c67d-489d-a7cf-e75e5e2654fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:09.193998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-850f8260-c67d-489d-a7cf-e75e5e2654fe None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:09.195631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-850f8260-c67d-489d-a7cf-e75e5e2654fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:09.246041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:09.361947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 696/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:09.735115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:09.736661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:09.925400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9db319-1ff0-4480-8f29-f2bba1d547fa None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:09.994807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:10.123516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:10.124656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:10.124912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:10.126053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:10.129019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:10.295212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:10.297389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278c3b3-dd1b-4882-af8c-2686c9277cf6 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:10.321407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 686/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:12.698082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03f10-4730-494a-acb0-306225d069cf None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:12.698658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03f10-4730-494a-acb0-306225d069cf None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:12.698908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03f10-4730-494a-acb0-306225d069cf None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:12.701210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 697/1383] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:12.716295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca329-0e88-447f-bef2-ddec919e0274 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:12.716992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca329-0e88-447f-bef2-ddec919e0274 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:12.716992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca329-0e88-447f-bef2-ddec919e0274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:12.807488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4ccca329-0e88-447f-bef2-ddec919e0274 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:12.808832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4ccca329-0e88-447f-bef2-ddec919e0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:12.811326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:12.952381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 687/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:13.284229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03f10-4730-494a-acb0-306225d069cf None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:13.285823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-75d03f10-4730-494a-acb0-306225d069cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:13.502986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03f10-4730-494a-acb0-306225d069cf None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:13.524704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:13.687277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:13.688051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:13.688395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:13.689026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:13.691112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:13.841533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:13.844416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96778ad8-4096-4d04-9152-828a19360149 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:13.871488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 698/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:15.920301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:15.920888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:15.921570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:15.923965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 688/1386] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:15.931546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fbb04-aed6-4a8a-924f-758a80c9c4f8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:15.932072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fbb04-aed6-4a8a-924f-758a80c9c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:15.932413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fbb04-aed6-4a8a-924f-758a80c9c4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:15.968844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:16.028639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-856fbb04-aed6-4a8a-924f-758a80c9c4f8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:16.029964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-856fbb04-aed6-4a8a-924f-758a80c9c4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:16.192141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 699/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:16.523238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:16.525327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:16.720488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:16.756968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57f8da-0402-4fa9-a5fa-7b76123f9a48 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:16.925439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:16.926476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:16.926943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:16.927302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:16.929731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:17.061746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:17.064263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375fbb8-5677-469d-844f-9a19d2bc6622 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:17.069988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:17.085190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 689/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:18.775573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840559-4ecf-4a2d-abc2-08ab08e8062e None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:18.776144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840559-4ecf-4a2d-abc2-08ab08e8062e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:18.776144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94840559-4ecf-4a2d-abc2-08ab08e8062e None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:18.777514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 700/1389] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:18.784146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c97ff-29d7-43cc-88a5-d836d7b7cf2f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:18.784635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c97ff-29d7-43cc-88a5-d836d7b7cf2f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:18.784734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c97ff-29d7-43cc-88a5-d836d7b7cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:18.858702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f73c97ff-29d7-43cc-88a5-d836d7b7cf2f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:18.860463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f73c97ff-29d7-43cc-88a5-d836d7b7cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:18.978869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 690/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:19.181063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a538-27fa-41a8-836d-f79a61c505cd None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.181344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a538-27fa-41a8-836d-f79a61c505cd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.181647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a538-27fa-41a8-836d-f79a61c505cd None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.183044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 701/1391] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:19.188436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.188752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.189034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.261139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:19.262484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:19.286210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:19.327684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f040-828a-41b1-a79b-7d71a31bb6e1 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.328155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f040-828a-41b1-a79b-7d71a31bb6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.328622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0f040-828a-41b1-a79b-7d71a31bb6e1 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.329988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 702/1392] 10.222.0.48 () {54 vars in 967 bytes} [Wed Aug 17 20:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:14:19.334840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.335120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.335389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.379566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 691/1393] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:19.417177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] MFA Rules not processed for user `e24a6be002b144dea05cfd340fdb173f`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:19.417177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:19.460154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:19.497532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 703/1394] 10.222.0.48 () {58 vars in 1064 bytes} [Wed Aug 17 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:19.505430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:19.506683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:19.601998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5cd12-117f-4000-8af0-32ab9cfb1565 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:19.672944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:19.680603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:19.682957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:19.688212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:19.688834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.689113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.689382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.691084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:19.817211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac2b2d-d76f-482e-bf03-bc6d51a13b0d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:19.818791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:19.820322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9939b-d863-449a-b721-110474878c01 service glance] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:19.841040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 692/1395] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:19.891330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:19.956902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:19.957508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:19.957794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:19.958095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:19.959712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:20.065361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:20.067044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a35f49-28c3-4baf-8a3c-a47e8a9e3701 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:20.097306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 704/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:20.865646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988b35-630e-4fb3-bdea-90aa5086b7c3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:20.866330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988b35-630e-4fb3-bdea-90aa5086b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:20.866867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988b35-630e-4fb3-bdea-90aa5086b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:20.946389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9d988b35-630e-4fb3-bdea-90aa5086b7c3 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:20.947636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9d988b35-630e-4fb3-bdea-90aa5086b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:20.992575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:21.057182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 693/1397] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:14:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:21.111155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:21.111693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:21.112111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:21.114629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 705/1398] 10.222.0.48 () {54 vars in 943 bytes} [Wed Aug 17 20:14:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:21.121592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e38b-bdf0-4b21-9c27-de319d0182f2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:21.121904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e38b-bdf0-4b21-9c27-de319d0182f2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:21.122225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7e38b-bdf0-4b21-9c27-de319d0182f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:21.217040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-80b7e38b-bdf0-4b21-9c27-de319d0182f2 None None] MFA Rules not processed for user `2598eac7e63d4e4385d2c7510fa16528`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:21.218776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-80b7e38b-bdf0-4b21-9c27-de319d0182f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:21.348628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 694/1399] 10.222.0.48 () {58 vars in 1040 bytes} [Wed Aug 17 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:14:21.359584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:21.362684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:21.479729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:21.550601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e95d71-4c20-4b7b-9a36-882100628d8c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:21.674419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:21.675125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:21.675414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:21.675685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:21.677432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:21.754665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:21.776566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:21.778192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f51e-5643-44e9-b5c5-04567234aa47 service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:21.787644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 706/1400] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:14:22.398233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:22.398832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:22.398935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:22.400307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 695/1401] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:22.406474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e382fc-ea5d-4d34-b085-f9005ff66ec9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:22.407037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e382fc-ea5d-4d34-b085-f9005ff66ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:22.407037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e382fc-ea5d-4d34-b085-f9005ff66ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:22.491641 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-47e382fc-ea5d-4d34-b085-f9005ff66ec9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:22.492948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-47e382fc-ea5d-4d34-b085-f9005ff66ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:22.617921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 707/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:22.908074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:22.909968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:22.932129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:23.093450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57eae-0306-4dac-b45a-6dfbf75900de None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:23.221044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:23.249698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:23.250375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:23.250652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:23.250918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:23.252568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:23.355119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:23.356923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69e28-8ebd-4184-b777-29d5d6c066ce service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:23.378386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 696/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:25.522528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:25.524200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:25.524997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:25.531532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 708/1404] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:25.533385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f580-338a-4afe-a5c0-5bffc8c4d150 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:25.533940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f580-338a-4afe-a5c0-5bffc8c4d150 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:25.534190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0f580-338a-4afe-a5c0-5bffc8c4d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:25.622847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-96d0f580-338a-4afe-a5c0-5bffc8c4d150 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:25.624436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-96d0f580-338a-4afe-a5c0-5bffc8c4d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:25.696818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:25.766287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 697/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:26.097607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:26.099173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:26.196694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:26.345336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b2c32-002a-4525-8dec-32efb9584a1a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:26.502660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:26.503444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:26.503963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:26.504300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:26.506229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:26.630992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:26.634814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838739-3e9a-4134-aca0-b6f90e2ee0c0 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:26.655815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 709/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:27.009498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:28.967421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:28.968100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:28.968100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:28.969370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 698/1407] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:28.975335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c26d-6a6b-4b26-ac85-3c08434b0f23 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:28.975892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c26d-6a6b-4b26-ac85-3c08434b0f23 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:28.975892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6c26d-6a6b-4b26-ac85-3c08434b0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:29.049042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-92e6c26d-6a6b-4b26-ac85-3c08434b0f23 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:29.050380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-92e6c26d-6a6b-4b26-ac85-3c08434b0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:29.157105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:29.164184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 710/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:29.467051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:29.468720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:29.655443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d34a4-64f6-4066-b1be-5ae0e5e08fbd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:29.702495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:29.795199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:29.796165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:29.796434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:29.796705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:29.798391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:29.946622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:29.948799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fffb-e88b-42a5-b709-5a11b21b6bdc service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:29.970871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 699/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:39.188728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:39.968175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=82 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:46.204092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f783-ca76-42d0-a343-3e1f7956fa69 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.204687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f783-ca76-42d0-a343-3e1f7956fa69 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.204687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014f783-ca76-42d0-a343-3e1f7956fa69 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.206752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 711/1410] 10.222.0.48 () {54 vars in 918 bytes} [Wed Aug 17 20:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:46.212110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945112-7f19-4d11-8081-b3b1df62b947 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.212683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945112-7f19-4d11-8081-b3b1df62b947 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.212683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22945112-7f19-4d11-8081-b3b1df62b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.298261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-22945112-7f19-4d11-8081-b3b1df62b947 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:46.299516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-22945112-7f19-4d11-8081-b3b1df62b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:46.421991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 700/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 17 20:14:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:46.437125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0cf72-c165-4fee-95cc-4089c665e3c2 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.437411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0cf72-c165-4fee-95cc-4089c665e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.437690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0cf72-c165-4fee-95cc-4089c665e3c2 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.439099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 712/1412] 10.222.0.48 () {54 vars in 918 bytes} [Wed Aug 17 20:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:14:46.444437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ee10-d1f6-4b3f-b4de-7dc359970b21 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:46.444721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ee10-d1f6-4b3f-b4de-7dc359970b21 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:46.444993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334ee10-d1f6-4b3f-b4de-7dc359970b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:46.528793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:46.532901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1334ee10-d1f6-4b3f-b4de-7dc359970b21 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:46.534195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1334ee10-d1f6-4b3f-b4de-7dc359970b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:46.664336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 701/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 17 20:14:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:49.125177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:49.125747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:49.125854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:49.127252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:49.132849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d943a-e54d-4689-966e-0e00204356d4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:49.133440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d943a-e54d-4689-966e-0e00204356d4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:49.133440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d943a-e54d-4689-966e-0e00204356d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:49.203900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b80d943a-e54d-4689-966e-0e00204356d4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:49.205667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b80d943a-e54d-4689-966e-0e00204356d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:49.266106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:49.311716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:49.609785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:49.611353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:49.762248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d34fa6-aaa3-46ba-a26a-4a9e8b111652 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:49.838595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:49.883389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:49.884094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:49.884387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:49.884738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:49.889545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:50.046949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:50.048580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667258b-cea7-48ce-98fe-8dff4a23229c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:50.067649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 714/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:50.974252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:50.974802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:50.974802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:50.976146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:50.982575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154f3e-bd8c-4050-964c-62b9ff03598d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:50.983093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154f3e-bd8c-4050-964c-62b9ff03598d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:50.983193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1154f3e-bd8c-4050-964c-62b9ff03598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:51.062499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a1154f3e-bd8c-4050-964c-62b9ff03598d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:51.063717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a1154f3e-bd8c-4050-964c-62b9ff03598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:51.091520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:51.162653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:51.314465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:51.316252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:51.469477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750d85-cee4-415d-90f6-2f04e9dc3375 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:51.511522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:51.591667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:51.592184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:51.592458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:51.592725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:51.594389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:51.687604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:51.689218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773718d-966b-438c-9f2c-fa71fa2a55f9 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:51.708673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 704/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:52.611454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:52.611979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:52.611979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:52.613258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:52.618305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b2014-5e7b-4cb6-b227-7a4a9c7237b0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:52.618743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b2014-5e7b-4cb6-b227-7a4a9c7237b0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:52.618849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b2014-5e7b-4cb6-b227-7a4a9c7237b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:52.672821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:52.694355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d71b2014-5e7b-4cb6-b227-7a4a9c7237b0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:52.695563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d71b2014-5e7b-4cb6-b227-7a4a9c7237b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:52.794003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:52.949807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:52.951411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:53.105360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667f19f-f679-4214-b5d2-73ac8bff0999 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:53.118031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:53.226352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:53.226886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:53.227167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:53.227435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:53.229108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:53.329854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:53.331620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b8dde-85d1-4778-a60a-ca6a60a941e0 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:53.351834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 717/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:54.243447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:54.244020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:54.244020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:54.245344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:54.250663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458028-be1b-485e-97ae-925a3712c652 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:54.251127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458028-be1b-485e-97ae-925a3712c652 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:54.251235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95458028-be1b-485e-97ae-925a3712c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:54.271461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:54.330137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-95458028-be1b-485e-97ae-925a3712c652 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:54.331363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-95458028-be1b-485e-97ae-925a3712c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:54.429692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:54.582148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:54.583623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:54.693521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:54.730648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b9ecb-067c-4232-9471-72b3e9206726 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:54.845534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:54.846082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:54.846365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:54.846636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:54.848259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:54.926122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:54.940782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:54.942429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce615f-09e8-4f13-8892-d4457b288b8d service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:54.961434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 707/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:55.828819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:55.829382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:55.829382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:55.830756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:55.835985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa32b-f491-429c-861a-b01052016b84 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:55.836496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa32b-f491-429c-861a-b01052016b84 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:55.836607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aa32b-f491-429c-861a-b01052016b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:55.918738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-153aa32b-f491-429c-861a-b01052016b84 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:55.920015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-153aa32b-f491-429c-861a-b01052016b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:56.024710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:56.179232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:56.180671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:56.274950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:56.341061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8112-621d-4a40-b864-ed5a282c9f60 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:56.462467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:56.462984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:56.463288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:56.463567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:56.465234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:56.519912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:56.564272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:56.565911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6eb32-dcb1-4e5f-8337-84b26656bc3c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:56.585419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 720/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:57.478086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:57.478667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:57.478667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:57.480175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:14:57.485213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9de477-5a60-4bd8-83eb-30b2498299d9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:57.485657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9de477-5a60-4bd8-83eb-30b2498299d9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:57.485774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9de477-5a60-4bd8-83eb-30b2498299d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:57.562500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5a9de477-5a60-4bd8-83eb-30b2498299d9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:57.563729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5a9de477-5a60-4bd8-83eb-30b2498299d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:57.663598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:57.816671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:57.818156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:57.872575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:57.976267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56eeec-e831-4032-8440-21ca2ff8c70f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:58.091888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:58.092412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:58.092691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:58.092962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:58.094604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:58.101686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:58.188947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:58.190631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d1f4b-cd07-4e95-86a6-24bb15f6e23f service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:58.209276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 710/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:59.076849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:59.077386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:59.077386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:59.078812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:14:59.084105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4ca5-80aa-42d4-9c82-e8c4548d5895 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:59.084574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4ca5-80aa-42d4-9c82-e8c4548d5895 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:59.084670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a4ca5-80aa-42d4-9c82-e8c4548d5895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:59.163321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c90a4ca5-80aa-42d4-9c82-e8c4548d5895 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:14:59.164540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c90a4ca5-80aa-42d4-9c82-e8c4548d5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:59.240615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:59.274647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:14:59.428556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:14:59.430114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:59.447871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:59.582743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee5fe-551d-4c67-8ab4-65f6c73e5cd7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:14:59.673459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:59.699541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:14:59.700074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:14:59.700365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:14:59.700646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:14:59.702328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:14:59.795357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:14:59.796974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1c7b7-2b39-40dd-ad1f-549dec73bf3e service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:14:59.815235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 723/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:00.692873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:00.693432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:00.693432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:00.694888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:00.700202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd90a50-9ea3-4e91-bef2-c1ee9208c54f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:00.700704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd90a50-9ea3-4e91-bef2-c1ee9208c54f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:00.700807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd90a50-9ea3-4e91-bef2-c1ee9208c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:00.778513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7dd90a50-9ea3-4e91-bef2-c1ee9208c54f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:00.779770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7dd90a50-9ea3-4e91-bef2-c1ee9208c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:00.822870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:00.879337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:01.035547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:01.035547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:01.187257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55978322-5813-46ac-87c4-810aa8b79d28 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:01.245589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:01.310578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:01.311144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:01.311424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:01.311696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:01.313456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:01.404577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:01.406227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd5b41-489c-4f52-9744-2232cd72b4ee service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:01.425971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 713/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:02.304208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:02.304798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:02.304798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:02.306149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:02.311886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28352-60c0-45cf-ad34-70f3c637cdf1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:02.312362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28352-60c0-45cf-ad34-70f3c637cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:02.312463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d28352-60c0-45cf-ad34-70f3c637cdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:02.393562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c2d28352-60c0-45cf-ad34-70f3c637cdf1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:02.394831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c2d28352-60c0-45cf-ad34-70f3c637cdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:02.396932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:02.495512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:02.650600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:02.652054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:02.809366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19c151-1daf-4009-9445-57bc75f2fd8e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:02.845272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:02.938195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:02.938815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:02.939080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:02.939349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:02.941177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:03.036726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:03.038396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06f2bf-8a76-4667-bdac-5e582b1e795c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:03.060193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 726/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:04.931278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:04.931866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:04.931866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:04.933269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:04.938738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928d79-71ce-428a-ae90-77714fb3740a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:04.939203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928d79-71ce-428a-ae90-77714fb3740a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:04.939308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928d79-71ce-428a-ae90-77714fb3740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:04.982468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:05.007532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e9928d79-71ce-428a-ae90-77714fb3740a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:05.008745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e9928d79-71ce-428a-ae90-77714fb3740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:05.110609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:05.402674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:05.404208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:05.509430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc450cbf-4a9e-414c-96b9-638de3490811 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:05.542644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:05.584480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:05.585088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:05.585363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:05.585630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:05.587800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:05.699776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:05.701200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dca7b-1703-47f1-8349-66d2cf2e8a39 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:05.720581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 716/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:07.891088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:07.891664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:07.891664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:07.893078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:07.898556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479cbd5-c648-45a2-a7ae-8f51344ed54d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:07.899020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479cbd5-c648-45a2-a7ae-8f51344ed54d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:07.899134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479cbd5-c648-45a2-a7ae-8f51344ed54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:07.968751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d479cbd5-c648-45a2-a7ae-8f51344ed54d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:07.970025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d479cbd5-c648-45a2-a7ae-8f51344ed54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:07.984147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:08.070623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:15:08.355637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:08.357178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:08.464353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5dc4-7d62-443f-b55b-d54909e66d4c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:08.476702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:08.541983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:08.542528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:08.542796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:08.543068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:08.544680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:08.658777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:08.662100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e4597-cf10-42d4-a92a-e3cc3a0c9d77 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:08.679052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 729/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:10.996127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:10.996700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:10.996700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:10.998063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:11.003625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3524-40f7-44f9-a67f-f4b9e03b4eeb None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:11.004063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3524-40f7-44f9-a67f-f4b9e03b4eeb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:11.004198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3524-40f7-44f9-a67f-f4b9e03b4eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:11.052760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:11.071504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-937c3524-40f7-44f9-a67f-f4b9e03b4eeb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:11.073077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-937c3524-40f7-44f9-a67f-f4b9e03b4eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:11.171821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:11.456016 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:11.457611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:11.566603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771dc1-405c-4159-a9e7-0f28c136a845 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:11.608332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:11.641832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:11.642481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:11.642753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:11.643023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:11.644660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:11.757680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:11.759689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad26b7b-9101-4292-9efe-016e6ba0c936 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:11.779584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 719/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:13.840571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:13.841168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:13.841168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:13.842552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:13.848094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a70-9f02-46ce-90bf-a4d380eb50e6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:13.848555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a70-9f02-46ce-90bf-a4d380eb50e6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:13.848669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da033a70-9f02-46ce-90bf-a4d380eb50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:13.914843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-da033a70-9f02-46ce-90bf-a4d380eb50e6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:13.916055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-da033a70-9f02-46ce-90bf-a4d380eb50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:13.937239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.015724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:14.304792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:14.307276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:14.414602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115f6df-7b3e-4307-af77-a6fb249c9ef8 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:14.435310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:14.490670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:14.491277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:14.491558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:14.491831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:14.494292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:14.606599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:14.607958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e55469-db24-49c3-9efb-4f98c0104113 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:14.625891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 732/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:16.701670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:16.702317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:16.702317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:16.703580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:16.709018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc4e4-11ec-486f-8d2c-9c10729dea56 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:16.709483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc4e4-11ec-486f-8d2c-9c10729dea56 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:16.709586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbc4e4-11ec-486f-8d2c-9c10729dea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:16.773872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:16.776562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f3bbc4e4-11ec-486f-8d2c-9c10729dea56 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:16.777794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f3bbc4e4-11ec-486f-8d2c-9c10729dea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:16.876226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:17.164997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:17.166684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:17.273821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9320ef-6e82-42f8-8ee8-85bec4c2f667 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:17.325051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:17.350532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:17.351147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:17.351451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:17.352274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:17.354057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:17.466144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:17.467612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd920f3-2aa4-4d8a-8296-8f6d46bd803c service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:17.487250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 722/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:19.483338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:19.483921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:19.483921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:19.485279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:19.490936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f164-a39c-4cbf-bf3d-cd795e951728 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:19.491411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f164-a39c-4cbf-bf3d-cd795e951728 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:19.491541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f164-a39c-4cbf-bf3d-cd795e951728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:19.560328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e791f164-a39c-4cbf-bf3d-cd795e951728 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:19.561550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e791f164-a39c-4cbf-bf3d-cd795e951728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:19.593075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:19.663443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:19.950243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:19.951823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:20.057040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40007b-edb7-4c52-b8d1-d636df419d02 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:20.085563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:20.135413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:20.136025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:20.136310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:20.136579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:20.138239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:20.251891 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:20.253265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdda0a-41ac-4e2e-847d-b8333f988fd9 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:20.274611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 735/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:22.261983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:22.262629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:22.262629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:22.263891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:22.269560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3ffd-c07f-4312-a4c4-a50d6463a688 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:22.270093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3ffd-c07f-4312-a4c4-a50d6463a688 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:22.270214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3ffd-c07f-4312-a4c4-a50d6463a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:22.341933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3c3b3ffd-c07f-4312-a4c4-a50d6463a688 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:22.343168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3c3b3ffd-c07f-4312-a4c4-a50d6463a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:22.352277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:22.443580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:15:22.729347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:22.730947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:22.836778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dcf55-2c46-4722-9edf-c3d1f6473021 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:22.892596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:22.912035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:22.918001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:22.918001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:22.918001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:22.918001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:23.025129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:23.026537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb11f12-3026-4d67-9e66-5b8929edcf31 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:23.045356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 725/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:25.031195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:25.032015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:25.032015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:25.033360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:25.038938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e922-c6a0-4bcf-9a8b-f7ab838a4b91 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:25.039348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e922-c6a0-4bcf-9a8b-f7ab838a4b91 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:25.039498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e922-c6a0-4bcf-9a8b-f7ab838a4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:25.110020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-58b4e922-c6a0-4bcf-9a8b-f7ab838a4b91 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:25.111260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-58b4e922-c6a0-4bcf-9a8b-f7ab838a4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:25.151754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:25.215065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:15:25.501369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:25.502924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:25.609370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279ef50-bb66-4479-9765-4d24609f4654 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:25.649261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:25.686839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:25.687440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:25.687715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:25.687981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:25.689570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:25.798057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:25.799401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544bf66-4a05-4db5-b763-4180927800e1 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:25.817542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 738/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:27.766849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:27.767464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:27.767464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:27.768740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:27.774650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749d3a-14bd-482b-bea1-d60d998632ad None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:27.775168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749d3a-14bd-482b-bea1-d60d998632ad None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:27.775168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749d3a-14bd-482b-bea1-d60d998632ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:27.966383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-bb749d3a-14bd-482b-bea1-d60d998632ad None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:27.967591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bb749d3a-14bd-482b-bea1-d60d998632ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:27.986038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:28.065950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:28.353360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:28.354951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:28.463470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d7caa-f030-439e-899f-e7d3608468e3 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:28.535920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:28.542760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:28.548503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:28.548503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:28.548503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:28.548503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:28.660208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:28.661691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3054f2-5679-4a09-a073-d01a93fdb2de service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:28.680474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 728/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:15:30.638634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:30.639181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:30.639181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:30.640422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:30.645778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bcb22-c430-4811-a12c-3ff65e2d35c3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:30.646276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bcb22-c430-4811-a12c-3ff65e2d35c3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:30.646405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73bcb22-c430-4811-a12c-3ff65e2d35c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:30.715047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a73bcb22-c430-4811-a12c-3ff65e2d35c3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:30.716286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a73bcb22-c430-4811-a12c-3ff65e2d35c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:30.767008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:30.820183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:31.102273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:31.103822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:31.214782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ec13b-4e5f-4617-abb3-ed74cbb51ff5 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:31.265601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:31.293064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:31.293675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:31.293994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:31.294265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:31.296216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:31.409424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:31.410908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e18b4-5e16-4685-a6c1-98d078530d71 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:31.429216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 741/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:40.817218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=22 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:41.427384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=66 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:51.474706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af19dd-d4a9-42f5-b751-80460c022fec None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:51.475292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af19dd-d4a9-42f5-b751-80460c022fec None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:51.475292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af19dd-d4a9-42f5-b751-80460c022fec None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:51.476634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 730/1471] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:51.482114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64a19-b3ba-4100-9756-829d76ebd8b7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:51.482710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64a19-b3ba-4100-9756-829d76ebd8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:51.482818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e64a19-b3ba-4100-9756-829d76ebd8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:51.556475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-97e64a19-b3ba-4100-9756-829d76ebd8b7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:51.557689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-97e64a19-b3ba-4100-9756-829d76ebd8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:51.669091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 742/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:51.970287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:51.970574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:51.970849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:51.972187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 731/1473] 10.222.0.48 () {54 vars in 967 bytes} [Wed Aug 17 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:51.977811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726f79-307d-4841-9f43-7493864e8d0d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:51.978122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726f79-307d-4841-9f43-7493864e8d0d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:51.978393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f726f79-307d-4841-9f43-7493864e8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:52.054571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7f726f79-307d-4841-9f43-7493864e8d0d None None] MFA Rules not processed for user `e24a6be002b144dea05cfd340fdb173f`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:52.055785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7f726f79-307d-4841-9f43-7493864e8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:52.076834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:52.134842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 743/1474] 10.222.0.48 () {58 vars in 1064 bytes} [Wed Aug 17 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:52.142632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:52.144210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:52.368659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547e3af-d36f-4919-9e3a-45af7a0e6c36 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:52.444960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:52.445569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:52.445846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:52.446143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:52.447744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:52.502359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:52.559395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:52.560757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606398-4f61-4069-aedc-e937622ff171 service glance] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:52.579954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 732/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:15:54.592174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:54.592725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:54.592725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:54.594015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 744/1476] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:54.600008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa94ab-e527-4b76-95cb-08ec15e9ce26 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:54.600492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa94ab-e527-4b76-95cb-08ec15e9ce26 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:54.600599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa94ab-e527-4b76-95cb-08ec15e9ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:54.669703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-faaa94ab-e527-4b76-95cb-08ec15e9ce26 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:54.670971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-faaa94ab-e527-4b76-95cb-08ec15e9ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:54.771126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 733/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:55.048755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:55.050403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:55.182261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd3842-20ae-4e96-80f7-0e3f42d27267 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:55.237642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:55.296837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:55.297492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:55.297771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:55.298153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:55.298961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:55.300915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:15:55.300915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:15:55.300915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:15:55.302120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615be21-93f5-472d-a292-c28b50bae3d1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:55.326062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 745/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 17 20:15:55 2022] GET /identity/v3/projects => generated 2553 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:15:57.319407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:57.320121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:57.320121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:57.321436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 734/1479] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:15:57.328266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30028-20e7-4633-b0a6-dbec44326a10 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:57.328846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30028-20e7-4633-b0a6-dbec44326a10 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:57.328980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb30028-20e7-4633-b0a6-dbec44326a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:57.409269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8fb30028-20e7-4633-b0a6-dbec44326a10 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:15:57.410506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8fb30028-20e7-4633-b0a6-dbec44326a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:57.522127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 746/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:15:57.819708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:15:57.821314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:57.832225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:57.979560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d31f-c12e-4085-ad68-ac420d41cbdf None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:15:58.066245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:58.109892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:15:58.110525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:15:58.110801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:15:58.111067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:15:58.112953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:15:58.207024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:15:58.208643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d18d8b-ad7d-4ac0-9255-c2b49e7d9281 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:15:58.227958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 735/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:00.382774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:00.383368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:00.383368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:00.384651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 747/1482] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:16:00.389972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ea66-0c6a-4064-9723-020684ed9374 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:00.390410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ea66-0c6a-4064-9723-020684ed9374 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:00.390526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757ea66-0c6a-4064-9723-020684ed9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:00.459153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6757ea66-0c6a-4064-9723-020684ed9374 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:16:00.460376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6757ea66-0c6a-4064-9723-020684ed9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:00.507143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:00.559081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 736/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:16:00.852595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:16:00.854243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:00.882914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:00.967795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68020067-f6f3-4f1e-8d1f-13a83e43c6ae None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:16:01.045797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:16:01.046436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:01.046711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:01.046977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:01.048612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:01.125668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:01.163008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:16:01.164478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1954931-f280-4181-9e7a-52c0cd44de6e service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:16:01.183816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 748/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:03.185844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:03.186436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:03.186436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:03.187761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 737/1485] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:16:03.193847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426559b-bc6a-46d2-a69b-1509a20f17b5 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:03.194367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426559b-bc6a-46d2-a69b-1509a20f17b5 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:03.194473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426559b-bc6a-46d2-a69b-1509a20f17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:03.261747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3426559b-bc6a-46d2-a69b-1509a20f17b5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:16:03.263040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3426559b-bc6a-46d2-a69b-1509a20f17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:03.361385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 749/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:16:03.668165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:16:03.668165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:03.764509 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4a3ae-7b32-4ea0-80f4-d3699782607c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:16:03.836983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:03.838672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:16:03.839218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:03.839495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:03.839767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:03.841463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:03.953755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:16:03.955225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08293ce8-35cf-440d-9bd2-9a85f8efd738 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:16:03.974081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 738/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:06.009715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:06.010355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:06.010355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:06.011747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 750/1488] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:16:06.016915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12dc1-bf6c-43aa-ae69-d611d5e16229 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:06.017333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12dc1-bf6c-43aa-ae69-d611d5e16229 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:06.017466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12dc1-bf6c-43aa-ae69-d611d5e16229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:06.085954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f7b12dc1-bf6c-43aa-ae69-d611d5e16229 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:16:06.087199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f7b12dc1-bf6c-43aa-ae69-d611d5e16229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:06.139432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:06.186553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 739/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:16:06.480401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:16:06.481992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:06.519115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:06.591816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612b8a8-f918-484f-9422-2c482e2a9e80 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:16:06.667450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:16:06.668049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:06.668324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:06.668591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:06.670228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:06.756121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:06.786359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:16:06.787716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d955a1-e115-4215-8ffb-27beee0807f8 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:16:06.805766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 751/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:09.168682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:09.169205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:09.169205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:09.170625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 740/1491] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 17 20:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:16:09.176010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919472-0ed5-48bb-b340-3d2b8e21d294 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:09.176467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919472-0ed5-48bb-b340-3d2b8e21d294 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:09.176570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919472-0ed5-48bb-b340-3d2b8e21d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:09.243448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4a919472-0ed5-48bb-b340-3d2b8e21d294 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:16:09.244667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4a919472-0ed5-48bb-b340-3d2b8e21d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:09.342855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 752/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 17 20:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:16:09.638473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:16:09.640026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:09.744125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc307-a7e1-49a1-8906-dcf75774fe58 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:16:09.818011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:16:09.818621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:16:09.818898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:16:09.819167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:16:09.820766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:16:09.831403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:09.932078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:16:09.933576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac873f3-b982-4e28-a0af-af029dde2891 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:16:09.951671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 741/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:16:19.341053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=82 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:16:19.949275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=50 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:38.679817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.680427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.680427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.760955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:38.762322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:38.859320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 753/1494] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:38.867448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:38.867960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:38.867960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:38.946850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:38.948956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.050095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 742/1495] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:39.054826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.056082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.068182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e70cb-ee75-4283-a43d-e033cbf97ccb None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.131150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:39.169508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.170148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.170429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.170709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.171360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:17:39.171655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.172679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.172679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:17:39.172679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:17:39.173571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.185818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 754/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:17:39.194263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.204167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83eecb-5555-4c84-884b-71f6cbc839d0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.269394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:39.304174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.304784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.305063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.305335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.305994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.308391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.308391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:17:39.308391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:17:39.309583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.476904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 743/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:17:39 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:17:39.482381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.483919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.518910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae8ccf-3875-49d5-9f0f-d5cf9d68972f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.619958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.620574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.620851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.621123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.621765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.622816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.622816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:17:39.622816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:17:39.625084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.755896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 755/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:17:39 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:17:39.760623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.762174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.832213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fa946-4293-48c2-99e6-4319efd033b3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.916214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:39.926537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:17:39.930889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:17:39.932044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:39.943497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 744/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:17:39.947672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:39.949343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:39.960784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2add8-5563-4ddc-81b8-226427fc57cb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:39.986950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:40.063227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:40.063794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.064114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.064424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.065110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:40.066207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:40.066207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:17:40.066207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:17:40.067169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc1d11-9bb3-4285-b695-9fa67a5f6d46 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:40.081522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 756/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:17:40.085740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:40.087380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.123148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0110a5-e149-4641-96f2-63f6b3eecfe6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:40.223883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:40.224546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.224830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.225099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] PATH_INFO: `/v3/projects/c0b3691e88384513b83dcf2a3c1aff90/users/03b22cb4660e4497af7fbd0728b2070d/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.249297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b3691e88384513b83dcf2a3c1aff90, user_id=03b22cb4660e4497af7fbd0728b2070d, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:40.250381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:40.250381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:17:40.250381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:17:40.252320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a012-4411-4ac0-a99a-a651c84f6049 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:40.355535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 745/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:17:40 2022] PUT /identity/v3/projects/c0b3691e88384513b83dcf2a3c1aff90/users/03b22cb4660e4497af7fbd0728b2070d/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:17:40.368215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418a5f-7af6-4719-a2ee-d8da1cec164a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.368499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418a5f-7af6-4719-a2ee-d8da1cec164a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.368775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418a5f-7af6-4719-a2ee-d8da1cec164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.436234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-de418a5f-7af6-4719-a2ee-d8da1cec164a None None] MFA Rules not processed for user `03b22cb4660e4497af7fbd0728b2070d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:40.437620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-de418a5f-7af6-4719-a2ee-d8da1cec164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.539580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 757/1502] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:17:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:40.553278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.553571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.553845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.555223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 746/1503] 10.222.0.48 () {54 vars in 964 bytes} [Wed Aug 17 20:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:17:40.560396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926794-af63-4786-9640-bf3a92557f0a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.560681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926794-af63-4786-9640-bf3a92557f0a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.560951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926794-af63-4786-9640-bf3a92557f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.592794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:40.645906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c1926794-af63-4786-9640-bf3a92557f0a None None] MFA Rules not processed for user `af188d89b2fe416884b5f80ff25b8d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:40.647053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c1926794-af63-4786-9640-bf3a92557f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.785288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 758/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Aug 17 20:17:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:40.793670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:40.795233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:40.848578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:40.907910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb819fe-8e23-40b9-a21e-593da42dd4c8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:40.987108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:40.987806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:40.987987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:40.988264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:40.989899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:41.097098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:41.098638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:41.102331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:41.117381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 747/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:17:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:17:41.163562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17526-c3db-468f-a305-e75e5cd52c61 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:41.163851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17526-c3db-468f-a305-e75e5cd52c61 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:41.164130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17526-c3db-468f-a305-e75e5cd52c61 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:41.166107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 759/1506] 10.222.0.48 () {52 vars in 830 bytes} [Wed Aug 17 20:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:17:41.169589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:41.171057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:41.277853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ac77-f34e-49f8-944e-bcd2d2814a12 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:41.389679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:41.390371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:41.390650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:41.391072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] PATH_INFO: `/v3/users/03b22cb4660e4497af7fbd0728b2070d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:41.405652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b22cb4660e4497af7fbd0728b2070d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:41.408247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:41.408247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:17:41.408247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:17:41.408247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:41.420250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:41.698322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b22cb4660e4497af7fbd0728b2070d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.792404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b22cb4660e4497af7fbd0728b2070d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.792896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b22cb4660e4497af7fbd0728b2070d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.793465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b22cb4660e4497af7fbd0728b2070d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.810053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b22cb4660e4497af7fbd0728b2070d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:41.840234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 748/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:17:41 2022] DELETE /identity/v3/users/03b22cb4660e4497af7fbd0728b2070d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:17:41.844689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:41.845206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:41.845315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:41.906619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:17:41.907967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:41.987128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:42.000672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 760/1508] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:17:42.010507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:42.011811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:42.122105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c5392-f94b-44ea-ab9c-14110708f579 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:42.179259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:42.199321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:42.200030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:42.200311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:42.200591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:42.202217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:42.327587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:42.329051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248581a-7230-4190-873a-e11d7adc76ea service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:42.349709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 749/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:17:42.929299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:17:42.930649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:17:42.943120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237c180-6224-4c9c-92ed-d4bea5e2877d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:17:43.049085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:17:43.049710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:17:43.050016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:17:43.050282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] PATH_INFO: `/v3/projects/c0b3691e88384513b83dcf2a3c1aff90` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:17:43.061267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b3691e88384513b83dcf2a3c1aff90)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:17:43.062330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:17:43.062330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:17:43.062330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:17:43.065957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:17:43.195317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b3691e88384513b83dcf2a3c1aff90', 'request_id': 'req-15ecf734-2340-4ada-9b1a-484f52fcedbb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:43.209599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b3691e88384513b83dcf2a3c1aff90', 'request_id': 'req-15ecf734-2340-4ada-9b1a-484f52fcedbb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:43.281013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b3691e88384513b83dcf2a3c1aff90', 'request_id': 'req-15ecf734-2340-4ada-9b1a-484f52fcedbb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:43.305428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] The token cache is being invalidate because project c0b3691e88384513b83dcf2a3c1aff90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:17:43.305708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:43.306287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-15ecf734-2340-4ada-9b1a-484f52fcedbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:17:43.307942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 761/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:17:42 2022] DELETE /identity/v3/projects/c0b3691e88384513b83dcf2a3c1aff90 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:17:52.346418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=62 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:17:53.303221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:21.970803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:21.971403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:21.971403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:21.972786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:21.977745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224b19-8fed-4bfb-80fd-30ffdf1fe1f3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:21.978202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224b19-8fed-4bfb-80fd-30ffdf1fe1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:21.978299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7224b19-8fed-4bfb-80fd-30ffdf1fe1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:22.063102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c7224b19-8fed-4bfb-80fd-30ffdf1fe1f3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:22.064360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c7224b19-8fed-4bfb-80fd-30ffdf1fe1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:22.175674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:19:22.333747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:22.336005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:22.461193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f4db2-20d9-453e-b22d-bf368964ffc1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:22.467350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:22.467949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:22.468227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:22.468503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:22.476677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:22.478296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a2c73-0d88-457f-b17b-a796cf19b09c service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:22.488380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 751/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:23.315518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e107-acb5-4fcc-9332-01ddd676ca40 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:23.316031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e107-acb5-4fcc-9332-01ddd676ca40 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:23.318075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e107-acb5-4fcc-9332-01ddd676ca40 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:23.318075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:23.322850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fef3d-9803-4a1f-9cd3-857c8ccee1b3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:23.323262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fef3d-9803-4a1f-9cd3-857c8ccee1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:23.323501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fef3d-9803-4a1f-9cd3-857c8ccee1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:23.344012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c45fef3d-9803-4a1f-9cd3-857c8ccee1b3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:23.345589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c45fef3d-9803-4a1f-9cd3-857c8ccee1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:23.353767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:23.508582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e107-acb5-4fcc-9332-01ddd676ca40 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:23.523399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e107-acb5-4fcc-9332-01ddd676ca40 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:23.528751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:23.529371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:23.529645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:23.529939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:23.537997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:23.539610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc56a89-f1e5-4eb0-97c0-8ec5bd3e87c5 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:23.549106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 764/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:23.679831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f120-3ea1-4dcc-94e4-4fd420746266 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:23.680114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f120-3ea1-4dcc-94e4-4fd420746266 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:23.680386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80f120-3ea1-4dcc-94e4-4fd420746266 None None] PATH_INFO: `/v3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:23.681790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 753/1517] 10.222.0.45 () {54 vars in 925 bytes} [Wed Aug 17 20:19:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:19:23.688517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647606-2eb5-45eb-8ccb-04c7bda2a243 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:23.688828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647606-2eb5-45eb-8ccb-04c7bda2a243 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:23.689099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52647606-2eb5-45eb-8ccb-04c7bda2a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:23.748616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-52647606-2eb5-45eb-8ccb-04c7bda2a243 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:23.749810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-52647606-2eb5-45eb-8ccb-04c7bda2a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:23.766690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:23.820433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 765/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 17 20:19:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:33.298312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08675-21c0-41c7-a4bd-441ec895c3d7 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:33.298835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08675-21c0-41c7-a4bd-441ec895c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:33.298835 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d08675-21c0-41c7-a4bd-441ec895c3d7 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:33.300122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 754/1519] 10.222.0.48 () {54 vars in 961 bytes} [Wed Aug 17 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:33.305274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90918-0575-4528-a75a-1a04741b40b9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:33.305680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90918-0575-4528-a75a-1a04741b40b9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:33.305839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90918-0575-4528-a75a-1a04741b40b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:33.325599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-25f90918-0575-4528-a75a-1a04741b40b9 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:33.330709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-25f90918-0575-4528-a75a-1a04741b40b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:33.335495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 766/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Aug 17 20:19:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:33.339718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=56 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:33.343823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d08675-21c0-41c7-a4bd-441ec895c3d7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:33.357863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d08675-21c0-41c7-a4bd-441ec895c3d7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:33.362926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:33.363526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:33.363814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:33.364084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:33.372856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:33.374550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55601424-5487-45d6-9d71-177f637f77b7 service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:33.384588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 755/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:34.803236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fa7d-68a9-4969-92fb-71468f6a572e None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:34.803812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fa7d-68a9-4969-92fb-71468f6a572e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:34.803812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fa7d-68a9-4969-92fb-71468f6a572e None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:34.805109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:34.810297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5600a-3e3b-4d62-9fe8-94aff7b95038 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:34.810761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5600a-3e3b-4d62-9fe8-94aff7b95038 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:34.810857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5600a-3e3b-4d62-9fe8-94aff7b95038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:34.830129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-94d5600a-3e3b-4d62-9fe8-94aff7b95038 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:34.831327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-94d5600a-3e3b-4d62-9fe8-94aff7b95038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:34.839997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:34.994948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58fa7d-68a9-4969-92fb-71468f6a572e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:35.010874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58fa7d-68a9-4969-92fb-71468f6a572e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:35.016488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:35.017096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:35.017368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:35.017670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:35.027357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:35.029118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beefd15-d1bc-41a5-864d-ed2bd79e04f8 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:35.040051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 768/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:35.879013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b832-6503-4a9c-9cab-fcead5b57450 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:35.879602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b832-6503-4a9c-9cab-fcead5b57450 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:35.879602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b832-6503-4a9c-9cab-fcead5b57450 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:35.880940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 20:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:35.886668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e68-bdfe-49b1-903c-95f7a4cdc777 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:35.887134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e68-bdfe-49b1-903c-95f7a4cdc777 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:35.887241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f72e68-bdfe-49b1-903c-95f7a4cdc777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:35.907637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b2f72e68-bdfe-49b1-903c-95f7a4cdc777 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:35.908835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b2f72e68-bdfe-49b1-903c-95f7a4cdc777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:35.916709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 20:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:36.071729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b832-6503-4a9c-9cab-fcead5b57450 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:36.086778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b832-6503-4a9c-9cab-fcead5b57450 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:36.092368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:36.092982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:36.093261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:36.093532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:36.102361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:36.103969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d0f51-63cb-446c-a644-d2cce0d390cc service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:36.114222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 758/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:39.975947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:39.976603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:39.976603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:39.977848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:39.983768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4c63-569d-4e2e-83ed-17fc079bd9a4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:39.984227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4c63-569d-4e2e-83ed-17fc079bd9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:39.984335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd4c63-569d-4e2e-83ed-17fc079bd9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:40.003361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-75bd4c63-569d-4e2e-83ed-17fc079bd9a4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:40.004569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-75bd4c63-569d-4e2e-83ed-17fc079bd9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:40.013260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:19:40.302427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:40.304125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:40.386345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e9c2-ddfe-48c3-87a3-3c676ed693ae None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:40.389998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:40.390624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:40.390894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:40.391157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:40.400164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:40.402204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af90e0-8e47-4d29-b67c-b6e8dc03b3c6 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:40.411601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 771/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:42.346012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492385f7-ebf5-4730-bcaf-1a084adf455d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:42.346567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492385f7-ebf5-4730-bcaf-1a084adf455d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:42.346567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492385f7-ebf5-4730-bcaf-1a084adf455d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:42.347945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:42.353017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34751f-e905-4cea-888b-8a8a300135f7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:42.353579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34751f-e905-4cea-888b-8a8a300135f7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:42.353866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34751f-e905-4cea-888b-8a8a300135f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:42.374540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9e34751f-e905-4cea-888b-8a8a300135f7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:42.375747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9e34751f-e905-4cea-888b-8a8a300135f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:42.383884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:19:42.668567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492385f7-ebf5-4730-bcaf-1a084adf455d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:42.679307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492385f7-ebf5-4730-bcaf-1a084adf455d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:42.683576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:42.684170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:42.684451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:42.684720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:42.693609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:42.695071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41cbd5-044f-4e9c-8f22-a4fbf11dbc79 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:42.704881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 761/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:46.174116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85603-1993-48b0-b650-a84a70148317 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:46.174682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85603-1993-48b0-b650-a84a70148317 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:46.174682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85603-1993-48b0-b650-a84a70148317 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:46.176101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:46.181423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad70e-a7a4-4c71-866a-64268761aac6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:46.181932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad70e-a7a4-4c71-866a-64268761aac6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:46.182062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbad70e-a7a4-4c71-866a-64268761aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:46.202133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dcbad70e-a7a4-4c71-866a-64268761aac6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:46.203347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dcbad70e-a7a4-4c71-866a-64268761aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:46.211327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:46.765897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85603-1993-48b0-b650-a84a70148317 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:46.767578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-45b85603-1993-48b0-b650-a84a70148317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:46.833428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:46.846437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85603-1993-48b0-b650-a84a70148317 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:46.850227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:46.850834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:46.851158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:46.851404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:46.860497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:46.861949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed989d7e-a58e-450c-a219-42a2b26c172f service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:46.873625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 774/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:48.852089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:48.853014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:48.853207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:48.854646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 20:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:19:48.860257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6faa-84b2-4e67-ac83-8b83676c29fd None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:48.860721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6faa-84b2-4e67-ac83-8b83676c29fd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:48.860827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6faa-84b2-4e67-ac83-8b83676c29fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:48.880299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-45fb6faa-84b2-4e67-ac83-8b83676c29fd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:19:48.881776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-45fb6faa-84b2-4e67-ac83-8b83676c29fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:48.890282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 20:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:19:49.467911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:19:49.470976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:19:49.483191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1051-87e6-42ad-abcd-33ff966cfc53 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:19:49.486999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:19:49.487632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:19:49.487936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:19:49.488231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:19:49.497444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:19:49.498917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193f0d0-cb88-4137-9b25-95308d5680d4 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:19:49.508503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 764/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:19:58.875195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=11 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:59.504182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=33 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:23.515165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.515913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.516274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.563719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:23.565958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:23.584684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 776/1540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:23.620280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.620908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.621233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.674478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:23.676752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:23.699323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 765/1541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:23.707598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:23.732743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd81da8-7b56-43b9-8b74-d68419dfe6f4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:23.746106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:23.747182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.747654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.748495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.749977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:23.750697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:23.758589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:23.787754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 777/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:23.804654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:23.829175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045867-5f7e-4d91-8c6d-bddfdcd7d83c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:23.842751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:23.843853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:23.844333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:23.844786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:23.846043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:23.849653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4201be-f53d-45bb-8352-554562ef80c8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:23.994856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 766/1543] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:24.000477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.027857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b099e5-558a-4087-b75d-0dad6ea62758 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.167657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b150-4288-4915-a5a0-09e178ee11b8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.167920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b150-4288-4915-a5a0-09e178ee11b8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.168201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27b150-4288-4915-a5a0-09e178ee11b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.182799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.183999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.184513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.184953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.186151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.195753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ef31c-d1ec-460c-9b1b-6d4f00d590a4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.219239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ba27b150-4288-4915-a5a0-09e178ee11b8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.220611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ba27b150-4288-4915-a5a0-09e178ee11b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.245033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 767/1544] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:24.254763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe264d1-8c29-476c-8a55-9301df2b3f2c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.255119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe264d1-8c29-476c-8a55-9301df2b3f2c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.255362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe264d1-8c29-476c-8a55-9301df2b3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.312144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fbe264d1-8c29-476c-8a55-9301df2b3f2c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.314578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fbe264d1-8c29-476c-8a55-9301df2b3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.334002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 768/1545] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:24.335446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.335858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.336134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.339029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 778/1546] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:23 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:24.349453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.349969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.350513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.386967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.389649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.425427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 769/1547] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.426756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.439007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.441591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.455462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bf45c-92f5-4c2f-8cb4-446f88d26ba5 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.470915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 779/1548] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.471367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.472427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.472756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.472897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.473304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.477664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:24.477664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.477664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:24.477664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:21:24.477664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:21:24.479043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7524084-1864-41f3-93ef-62fa273f18f0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.490455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb54318-8f2a-4015-b694-70d81f1126ac None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.506848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.507908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.508411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.509834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.510854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.512865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038cb4b-0314-4723-a0a4-8609cac81f2e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.515677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 770/1549] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:24.519437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06044-776a-4dc4-81e0-855d6c4b4ad7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.524046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06044-776a-4dc4-81e0-855d6c4b4ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.525401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f06044-776a-4dc4-81e0-855d6c4b4ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.539417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 780/1550] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:24.547145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.549921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.551089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.571464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-50f06044-776a-4dc4-81e0-855d6c4b4ad7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.573759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-50f06044-776a-4dc4-81e0-855d6c4b4ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.587333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 771/1551] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.587333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.587333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.587333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.589663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.591284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.602661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 781/1552] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.605208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.619591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.622978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.623678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d75efc-6fd2-4ad6-be98-8fd31d1cfc73 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.628467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.629107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.629387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.629654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.630429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.631659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:24.631659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:21:24.631659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:21:24.633111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.638665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 772/1553] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.641188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.659749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db190db-32f1-461d-9f08-a35998ccb08b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.666045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.671198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.671198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.671198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.671198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.671198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc943bbe-22d5-4123-a4f9-6fbf85f0fe0c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.683499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 773/1554] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:24.686923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.686923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.686923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.708922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.710595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.725986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 774/1555] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.725986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.737778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9ae0f-88b2-465a-8c17-1afd6f20b703 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.743383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.744887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.745170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.745444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.746210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:24.746521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.748495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd45d-518c-4705-b429-f0d2488c64ee admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.765003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 775/1556] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:24.767091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.768784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.769339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.805772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.811416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 782/1557] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:24.811416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.812035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.916116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 776/1558] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.917162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:24.920628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f43e1-7bb0-4607-bee5-a79bdb4565a5 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.927400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.928293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.928538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06d74d-4d57-40c9-868d-d1fd948ccda7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:24.928756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.929139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.930029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:24.930462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.933169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795de3d1-a489-48e0-83a5-1bbaf07cc2fa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.935348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:24.936092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.937308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.937308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] PATH_INFO: `/v3/projects/fa0329dfefa64f94b06e6cbf623a9be4/users/46b27047a70c437e8ff046a02a0db8ad/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.948911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 783/1559] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:24.950289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424e1a-1cad-475a-a9ff-14f91d1d82bf None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.950584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424e1a-1cad-475a-a9ff-14f91d1d82bf None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.950871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a424e1a-1cad-475a-a9ff-14f91d1d82bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:24.963415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0329dfefa64f94b06e6cbf623a9be4, user_id=46b27047a70c437e8ff046a02a0db8ad, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:24.966394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:24.973313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6a424e1a-1cad-475a-a9ff-14f91d1d82bf None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:24.974613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6a424e1a-1cad-475a-a9ff-14f91d1d82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:24.983665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 784/1560] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:24.985839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:24.986362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:24.986847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.014027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.015309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.024323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 785/1561] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.025320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.031540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:25.035807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ece8e9-005f-457e-b612-06b9493333a6 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.041111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.041842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.042160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.042442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.043094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.045069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2ca26-b696-481c-a786-98f3fad542b8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.113183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 777/1562] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:24 2022] PUT /identity/v3/projects/fa0329dfefa64f94b06e6cbf623a9be4/users/46b27047a70c437e8ff046a02a0db8ad/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:25.114368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.146631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:25.201072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 786/1563] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:25.202386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.202676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.202952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.225186 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c7add-4c8b-426a-a186-9997bd6a1583 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.227600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.229684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.304104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.304885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.305264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.305627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.307083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.308413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:25.308413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:21:25.308413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:21:25.310416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1f59e-1494-4020-99bc-e348078cc489 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.345419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 787/1564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.347002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.365603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2c58-d2f2-4acc-b4e0-a922a6817f8f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.374076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.375120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.375596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.376056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.377234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:25.377785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.381102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.405377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 788/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:25.406884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.424790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a556c1d-d35b-4040-8f76-ce41ec0721f8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.433106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 778/1566] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/users => generated 286 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:25.434367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.434575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.434712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.435152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.435363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.435531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.435679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.436708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.440489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3bd9-94d5-4434-9514-83dd59100b7c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.456925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.458223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.472195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 779/1567] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.472195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.483406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c748882-23c5-4f18-8a0a-a998f8ae072e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.490977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.491930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.492333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.492810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.493781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:25.495294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.499158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad655c25-8e7a-4578-9514-32933c1d3836 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.513164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 780/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:25.514628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a01a-388b-412b-ba64-9d773792574a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.514919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a01a-388b-412b-ba64-9d773792574a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.515173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a01a-388b-412b-ba64-9d773792574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.539412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7153a01a-388b-412b-ba64-9d773792574a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.542656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7153a01a-388b-412b-ba64-9d773792574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.555643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 781/1569] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.558119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a01a-388b-412b-ba64-9d773792574a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.572594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 789/1570] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:25.574918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.575277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.575727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.577044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a01a-388b-412b-ba64-9d773792574a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.598778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:25.600050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:25.663999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.664942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.665117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.665363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.666142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.668327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.695614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 790/1571] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:25.695614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.712994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4205b-20a8-49f3-9836-ecfa8b9971dc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.712994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.712994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.712994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.713716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.713716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.713716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.843974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 782/1572] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:25.844845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.857111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a46a2c-cb9e-4e1d-a220-0ab9da25e51a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.862430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.863069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.863353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.863630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.864382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.866092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:25.879514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 783/1573] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:25.881015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.896091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b146-d704-4f73-b470-4672eddf5596 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:25.898314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 791/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/projects => generated 389 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:25.899603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:25.912262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:25.950572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:25.992244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:25.992814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:25.993099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:25.993369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:25.995003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:25.995318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:25.997128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.001395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab63cce-7f11-4691-abc2-832f94a3772d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.007754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.008726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.009147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.009512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.010939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.013142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.026059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 784/1575] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:26.026059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.026059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:26.118236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70286-b35a-4a48-8313-c6da6972eb25 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.125136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.127020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.127020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.127291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.144531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.147463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.164173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 785/1576] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:26.165080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.176673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc56b-ec39-4dbe-9dbd-4ba61018b1aa service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.184697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.186027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.186466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.186979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.188181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.192370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.208833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 792/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:25 2022] POST /identity/v3/projects => generated 367 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.211300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.290866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5cd19-6804-437e-a8a7-affb0d790924 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.297017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.297715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.298049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.298320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.298991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:26.299292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.300942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.317222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 793/1578] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:26.318491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.341332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 786/1579] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.343923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.345479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38dce-c256-4473-94c1-91cc3aab6350 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.352770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.354271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.355741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.356170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.357006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.359928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.366932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8dd68-c16d-4c55-ad66-5ca46b09dfe8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.377203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.377924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 794/1580] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:26.379290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.383872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.385020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.386154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.387712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.392460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.399532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87e54-8226-4484-80a5-a2c6c301a80a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.408544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.409535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.410017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.410497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.411542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.415581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.415851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 787/1581] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:26.420436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.443306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b50ca-c619-49fe-9d31-265264e5c153 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.451304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.452409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.452893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.453345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.454759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.458793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.555067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 795/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.555067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.576246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12290ba4-63bb-402b-ac34-60f8c103d0e4 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.579852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.581128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.581432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.582007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.589187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.589187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.623304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 788/1583] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.624271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.681720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 796/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.681720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.690726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e484c8-e488-4754-bba0-86cf13f15abb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.728771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:26.738227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bdaf4-b420-41a5-81b1-adfc7e691901 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.747076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.748090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.748604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.749106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.750443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.754402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.800946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.801869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.802654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.803160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.804332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.807821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.810434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:26.824510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 797/1585] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:26.825715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.841106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44221db-527e-459a-9453-f96f3d62756a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.846954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.847789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.848142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.848511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.849354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.851293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.869360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 798/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:26.870512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:26.882125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b582d38-09e0-4746-bb7a-7a5dc724bafa admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:26.888800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:26.889588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:26.890041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:26.890384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] PATH_INFO: `/v3/projects/58c323c9a3fd44178ac692ca801de9d3/users/f1b705a5c39d46b7a340343c24ae0455/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:26.908679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c323c9a3fd44178ac692ca801de9d3, user_id=f1b705a5c39d46b7a340343c24ae0455, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:26.909748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:26.909748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:21:26.909748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:21:26.911812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:26.931675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 789/1587] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:26 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:26.933184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.037982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 799/1588] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:26 2022] PUT /identity/v3/projects/58c323c9a3fd44178ac692ca801de9d3/users/f1b705a5c39d46b7a340343c24ae0455/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:27.038911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.060719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4eeea-b745-4663-9794-72532413481c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.133226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86438c5d-4b3a-40be-84f6-3cd827eba492 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.139729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.140512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.140737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.140937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.141509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.143980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.155756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.156400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.156665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.156941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.158060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.161123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.171350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 790/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.172805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.188535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d57058-a3b5-4a69-9776-4bc13d707941 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.194466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.195229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.195594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.195988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.196727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.199501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.221462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 791/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.222834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.246542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5961ae-b172-48ab-9bd0-960a9ed3b118 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.251483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.252551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.253043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.253513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.254763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.257868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.285582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 800/1591] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:27.285866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 792/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.285866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.288777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.306887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894d1a-6f51-48bd-9c82-68ec62cb5691 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.311595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a33b3-9ba6-4274-93be-a3cc751e4416 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.316965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.318354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.318792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.319025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.319671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.320108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.320610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.321023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.321189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] PATH_INFO: `/v3/projects/1f01b648becc418083f273214c7b01ae/users/8b5436339e8347ceb7e62d14e2b6e5f3/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.327041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ac2fb-0d15-4070-84ca-f621d450cca9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.346386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f01b648becc418083f273214c7b01ae, user_id=8b5436339e8347ceb7e62d14e2b6e5f3, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.352848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.462882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 793/1593] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:27.464775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.465155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.465531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.499089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 801/1594] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:27 2022] PUT /identity/v3/projects/1f01b648becc418083f273214c7b01ae/users/8b5436339e8347ceb7e62d14e2b6e5f3/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:27.499089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.516329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] MFA Rules not processed for user `f1b705a5c39d46b7a340343c24ae0455`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:27.516329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.585039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:27.595356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63200ca-64cd-460e-8a07-b11115464347 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.601931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.602880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.603378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.603806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.605685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.608333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.629692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 802/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.632977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.653707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9929ef1-4a7d-43c4-9bce-a87439cd561e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.659207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 794/1596] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:27.660540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.667086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.668332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.668571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.668931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.670039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.672546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.675961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa0f14-1203-4489-91fd-23eac8d500ff None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.681355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.682225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.682981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.683257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.684132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.685830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.688382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 803/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.689583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.697479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 795/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.701682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.703412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda395a-9467-4871-b506-cc4fb45b7d1d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.710268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.713089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.713089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.713089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] PATH_INFO: `/v3/projects/27dbbd158d484fb98a2bf71e65a9a6ea/users/0705d79d87ee4adc913a4266c2f3139b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.714129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd6503-a18d-45e1-af66-c00f1258ba43 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.718860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.719504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.719785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.720058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.720718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.722453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fb439-4698-4991-845b-b0f760317675 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.727696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:27.737717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 796/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:27.740469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27dbbd158d484fb98a2bf71e65a9a6ea, user_id=0705d79d87ee4adc913a4266c2f3139b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:27.741288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.741919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.742363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:27.746693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:27.780602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] MFA Rules not processed for user `8b5436339e8347ceb7e62d14e2b6e5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:27.781908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:27.851290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 804/1600] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:27 2022] PUT /identity/v3/projects/27dbbd158d484fb98a2bf71e65a9a6ea/users/0705d79d87ee4adc913a4266c2f3139b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:27.852009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.890525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 797/1601] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:27.892250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:27.910745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b1240-c096-466d-a6c2-fdde4cb9ac30 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.988453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d2bf-ef1e-4837-bdf1-253db973e092 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:27.993572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:27.994490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:27.995162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:27.995162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.003172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.003555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.003748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.003890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.003890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.003890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] PATH_INFO: `/v3/projects/364fc437561449b68b69ed4380bca24b/users/2e9acd97be994f3ca7e36732f28470c2/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.029906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364fc437561449b68b69ed4380bca24b, user_id=2e9acd97be994f3ca7e36732f28470c2, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.033725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.115324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 798/1602] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:28.116258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.166234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 805/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:27 2022] PUT /identity/v3/projects/364fc437561449b68b69ed4380bca24b/users/2e9acd97be994f3ca7e36732f28470c2/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:28.166473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.183363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:28.282890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e744-b26f-4b98-a1c1-d316161596bc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.365299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b76ec-7154-4a45-ba8d-53e724855724 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.379511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.379511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.379511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.379511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.379996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.381040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.402838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 806/1604] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:28.404607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.420216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.421262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.421736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.422262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] PATH_INFO: `/v3/projects/3e837f789d43409b80a1b62383c72598/users/0232d9581aa648038448830511db9efc/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.425232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80750811-d658-4dfe-8651-788b616537cb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.440869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.443240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.443240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.443240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.443879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.446879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ca85c-7824-469f-9364-85d271bc2f75 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.449776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e837f789d43409b80a1b62383c72598, user_id=0232d9581aa648038448830511db9efc, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.454546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73aa317-129a-4b73-a856-65900cd05e95 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.473437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 807/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:28.473437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660f51-d3bf-48e8-b5fd-80c29dee3597 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.473437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660f51-d3bf-48e8-b5fd-80c29dee3597 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.473437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b660f51-d3bf-48e8-b5fd-80c29dee3597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.509100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3b660f51-d3bf-48e8-b5fd-80c29dee3597 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:28.513309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3b660f51-d3bf-48e8-b5fd-80c29dee3597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.532890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 808/1606] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:28.532890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a89e-909e-44e8-95e6-f8adcd2fd622 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.532890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a89e-909e-44e8-95e6-f8adcd2fd622 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.532890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a89e-909e-44e8-95e6-f8adcd2fd622 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.532890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 809/1607] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 17 20:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:28.533857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2a89e-909e-44e8-95e6-f8adcd2fd622 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.555979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2a89e-909e-44e8-95e6-f8adcd2fd622 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.562813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.563682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.564138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.564536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.565295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.567935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.594949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 799/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:28 2022] PUT /identity/v3/projects/3e837f789d43409b80a1b62383c72598/users/0232d9581aa648038448830511db9efc/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:28.598289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.598978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.599802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.631802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:28.633064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:28.690042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 810/1609] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:28.691688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.707219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925c489-a838-4541-88c5-25c8eb565557 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.733946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 800/1610] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:28.733946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.754376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f731bd-75aa-4328-acae-02cdbb429ff7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:28.761807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.762986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.764080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.764080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] PATH_INFO: `/v3/projects/8a649c4f81ca474590d411b112cdbe3b/users/52b6c508e4f74034a56bc229d6cd2c47/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.764658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:28.792533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a649c4f81ca474590d411b112cdbe3b, user_id=52b6c508e4f74034a56bc229d6cd2c47, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.795723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.817563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:28.818504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.818504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.818991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] PATH_INFO: `/v3/projects/b2228eabebfa4bab9fa6cbef7276117e/users/f429ea829f45484587a09157e1793650/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:28.839391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2228eabebfa4bab9fa6cbef7276117e, user_id=f429ea829f45484587a09157e1793650, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:28.842461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca631b-56c0-4dd2-a3c1-1859cf5db40b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:28.933971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 801/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:28 2022] PUT /identity/v3/projects/8a649c4f81ca474590d411b112cdbe3b/users/52b6c508e4f74034a56bc229d6cd2c47/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:28.935918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:28.973938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 811/1612] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:28 2022] PUT /identity/v3/projects/b2228eabebfa4bab9fa6cbef7276117e/users/f429ea829f45484587a09157e1793650/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:28.977673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:28.978600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:28.980262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.013926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:29.036368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace8b-f823-409f-bd90-f8bc292dbb0c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.065821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:29.067455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.104212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.105866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.106189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.106464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.222449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.224533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb1290-c967-47ad-a93d-ef181cda28d5 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.240083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 802/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:29.240579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 812/1614] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 17 20:21:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:29.242122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26eb8-291e-46c7-a848-f6fdcf71ac8b None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.242275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.242705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26eb8-291e-46c7-a848-f6fdcf71ac8b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.243169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26eb8-291e-46c7-a848-f6fdcf71ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.272442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca554103-8a1b-414c-ac4a-2372a7f9742f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.283788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.285354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.286268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.287101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.295179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7ae26eb8-291e-46c7-a848-f6fdcf71ac8b None None] MFA Rules not processed for user `0232d9581aa648038448830511db9efc`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:29.295323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.296845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7ae26eb8-291e-46c7-a848-f6fdcf71ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.298191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.329673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 813/1615] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:29.329673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.342549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969968-51e5-47ca-9d2a-5d82ced148d3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.347184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.347616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.347814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.348130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.361392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.363472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf784b-359c-41b6-9d86-28d0e9921ab4 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.384282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 814/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:29.384282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.384282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.384282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.421338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] MFA Rules not processed for user `52b6c508e4f74034a56bc229d6cd2c47`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:29.423326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 803/1617] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:29.526416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:29.539527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 804/1618] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:29.539527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.571334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1276c78-ef2f-4687-92ad-3a3483677a7e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.583204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:29.595635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 815/1619] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:29.603061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.609411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.610304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.610995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.611591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.617012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e315e-41c1-44fc-b517-abfad20ea79e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:29.628431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:29.630847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:29.631447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:29.631920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] PATH_INFO: `/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9/users/848d216d177e413c8f83fd94c833594c/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:29.679355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e5abfc70924c5cb1f9c8fe72add9b9, user_id=848d216d177e413c8f83fd94c833594c, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.685123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.705080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:29.765219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:29.768033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:29.786203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 805/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:29.787266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.864122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 816/1621] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:29 2022] PUT /identity/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9/users/848d216d177e413c8f83fd94c833594c/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:29.867880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:29.962372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205bc36-ac4e-47ea-9c23-fcd20569b2c8 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.032136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5caf5-e0cd-473f-9555-b425e0840632 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.041226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.045325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.046360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.046929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.081563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.082178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.082460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.082991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.307495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.310644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.333268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 817/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:30.334588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.345482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.348088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.357531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5322b-47a8-4c4c-ac2d-fb6b70a693f8 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.376804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.377441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.377713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.378012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.378665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.380836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.400114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 806/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:30.401857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.459140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa4061-dcde-434e-8e0a-f439e708ce59 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.473589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.474278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.482460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.482749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.483521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.485263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.518234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 807/1624] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:30.519490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.550469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e618cf-a467-42f9-a985-951d9b395b2c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.560428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 818/1625] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:30.560736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.569232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.569232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.569232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] PATH_INFO: `/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9/users/848d216d177e413c8f83fd94c833594c/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.569232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e5abfc70924c5cb1f9c8fe72add9b9, user_id=848d216d177e413c8f83fd94c833594c, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.570663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685edd5-e71a-4124-8488-8ad240e6f470 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:30.573518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:30.615249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 808/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:30 2022] PUT /identity/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9/users/848d216d177e413c8f83fd94c833594c/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:30.625518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.625992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.626474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.706292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11637e02-e80c-4236-9cda-af5fa634294f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:30.706507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:30.719341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:30.746850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] MFA Rules not processed for user `848d216d177e413c8f83fd94c833594c`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:30.749657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:30.833143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:30.834015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:30.835410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:30.835796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:30.839003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:30.846052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.184232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 809/1627] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:31.190198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 819/1628] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:30 2022] POST /identity/v3/users => generated 300 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:31.199336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.201982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.204367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d06240-38ff-49f2-8334-978ebaaa6554 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.204367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.204367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.204367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4b063-0872-4f87-bf53-768687beb0e3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 810/1629] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41ee9-0194-4d73-a644-35e02880856d None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.206051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41ee9-0194-4d73-a644-35e02880856d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.207421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a41ee9-0194-4d73-a644-35e02880856d None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.207421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 811/1630] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 17 20:21:31 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:31.207421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a41ee9-0194-4d73-a644-35e02880856d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.220428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a41ee9-0194-4d73-a644-35e02880856d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.222666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edfaaa-8327-4bbd-a982-ba81733f7668 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.233296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.233296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.234067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.234878 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.235677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.236376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.236817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.237966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] PATH_INFO: `/v3/projects/979dabbdbab848f0ad53ef686aae15c3/users/bb53d6bd855d4163a13a34d6207c6768/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.265289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.266965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400d38c-f82a-4a81-8108-94d872803959 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.280856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 820/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:31.282680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a761-5b2c-4c6a-9e2a-d4c99ade7f26 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.283332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a761-5b2c-4c6a-9e2a-d4c99ade7f26 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.283703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742a761-5b2c-4c6a-9e2a-d4c99ade7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.287004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979dabbdbab848f0ad53ef686aae15c3, user_id=bb53d6bd855d4163a13a34d6207c6768, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.296375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.334503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9742a761-5b2c-4c6a-9e2a-d4c99ade7f26 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:31.335986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9742a761-5b2c-4c6a-9e2a-d4c99ade7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:31.486215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 812/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:31 2022] PUT /identity/v3/projects/979dabbdbab848f0ad53ef686aae15c3/users/bb53d6bd855d4163a13a34d6207c6768/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:31.487652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.546529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 821/1633] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:31.562154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025f84-520e-40f3-9613-9e8e1b6ae37a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.562470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025f84-520e-40f3-9613-9e8e1b6ae37a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.562736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e025f84-520e-40f3-9613-9e8e1b6ae37a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.564963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 822/1634] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 17 20:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:31.578585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943a69-f99a-4c45-a796-3836528d1b96 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.578899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943a69-f99a-4c45-a796-3836528d1b96 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.579124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e943a69-f99a-4c45-a796-3836528d1b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.638285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4e943a69-f99a-4c45-a796-3836528d1b96 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:31.643311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4e943a69-f99a-4c45-a796-3836528d1b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:31.724714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5532e-82a0-40b1-b78d-bcfe0f1adec5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.754508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.755992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.756393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.756699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.757362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.771878 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.794317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 813/1635] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:31.795474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:31.823808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cdf29-c705-48c9-a2f5-f25501593ff2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:31.842597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:31.845097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.845781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.849250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] PATH_INFO: `/v3/projects/979dabbdbab848f0ad53ef686aae15c3/users/bb53d6bd855d4163a13a34d6207c6768/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.854577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=979dabbdbab848f0ad53ef686aae15c3, user_id=bb53d6bd855d4163a13a34d6207c6768, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:31.861920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:31.879658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 823/1636] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:31.885704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 814/1637] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:31 2022] PUT /identity/v3/projects/979dabbdbab848f0ad53ef686aae15c3/users/bb53d6bd855d4163a13a34d6207c6768/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:31.898014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:31.898663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:31.899304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:31.998123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] MFA Rules not processed for user `bb53d6bd855d4163a13a34d6207c6768`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:32.001787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:32.074289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.244770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddacf7d-fa5f-4c57-be13-d5270eeec9ea admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.251321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.252488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.252661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.253290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.292809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 824/1638] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:32.498582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.503141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81506ef0-4dd6-4092-b0be-fdef814e2369 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.557006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 815/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:32.646733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:32.674901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:32.703216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce9fba-c0e8-425d-a8f4-dea8c4192d34 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:32.740380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:32.744259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.748729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.749158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.812568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:32.817061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912578d-2049-465b-b8dc-1d81f47ffc70 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:32.828476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:32.882599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 825/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:32.909669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208f66-d5a5-411a-80c8-15f8e7f21bb8 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.910122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208f66-d5a5-411a-80c8-15f8e7f21bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.912722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07208f66-d5a5-411a-80c8-15f8e7f21bb8 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.913239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 816/1641] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 17 20:21:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:21:32.921272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:32.922172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:32.922670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:32.960165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208f66-d5a5-411a-80c8-15f8e7f21bb8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.018575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:33.023768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:33.056260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 826/1642] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:33.074680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.094698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0422-d5d5-4a8b-83e4-2467edc9908c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.105709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.108403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.110297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.111515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.138849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.142448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.160605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07208f66-d5a5-411a-80c8-15f8e7f21bb8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.171556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.173930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.174278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.175734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] PATH_INFO: `/v3/users/52b6c508e4f74034a56bc229d6cd2c47` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.179565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b6c508e4f74034a56bc229d6cd2c47)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.207911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 827/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:33.209163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.433367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:33.491924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cad91-2c5b-48ae-8916-f61a84f0a89c service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:33.504797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:33.506417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:33.506880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:33.507360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] PATH_INFO: `/v3/users/8b5436339e8347ceb7e62d14e2b6e5f3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:33.519482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5436339e8347ceb7e62d14e2b6e5f3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:33.519482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: WARNING py.warnings [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:33.519482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: warnings.warn(msg) Aug 17 20:21:33.519482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: Aug 17 20:21:33.520556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:33.692517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b6c508e4f74034a56bc229d6cd2c47'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:33.837030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b6c508e4f74034a56bc229d6cd2c47'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:33.840503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b6c508e4f74034a56bc229d6cd2c47'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:33.843524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b6c508e4f74034a56bc229d6cd2c47'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:33.893969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24a374da-7ffb-491e-9d19-7e47907eef2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b6c508e4f74034a56bc229d6cd2c47'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:33.931848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5436339e8347ceb7e62d14e2b6e5f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:34.001867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 817/1644] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:32 2022] DELETE /identity/v3/users/52b6c508e4f74034a56bc229d6cd2c47 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:34.009945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.010429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.010707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.024645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5436339e8347ceb7e62d14e2b6e5f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:34.027234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5436339e8347ceb7e62d14e2b6e5f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:34.028933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5436339e8347ceb7e62d14e2b6e5f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:34.056287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:34.063744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.079515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-948ad2ab-5a73-441e-b53b-3ce6c2fe6219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5436339e8347ceb7e62d14e2b6e5f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:34.147667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 828/1645] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:33 2022] DELETE /identity/v3/users/8b5436339e8347ceb7e62d14e2b6e5f3 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:34.154304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.155313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.156096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.182021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 818/1646] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:34.199408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.202404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.219520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:34.222562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.313201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03144adb-964b-4db1-a030-4ca1bc8f08ee None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.510073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.515109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.516183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.517420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.524899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 829/1647] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:34.531712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.535506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:34.552106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:34.556227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.564749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.583244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b5ea-59ea-4635-bcc5-1aad0cd527f2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.592515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.593924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.594797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.595216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] PATH_INFO: `/v3/users/f1b705a5c39d46b7a340343c24ae0455` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.598678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 819/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:21:34.601459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:34.609474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b705a5c39d46b7a340343c24ae0455)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.620633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.631456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeee254-fbe0-482a-8d95-5187f235f535 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:34.642800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:34.647108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:34.648068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:34.649038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:34.676210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:34.680452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d49f9-8aba-41ba-bcae-d7bb1be8494f service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:34.727457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 820/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:34.755062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:35.059783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b705a5c39d46b7a340343c24ae0455'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:35.145702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b705a5c39d46b7a340343c24ae0455'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:35.145702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b705a5c39d46b7a340343c24ae0455'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:35.145702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b705a5c39d46b7a340343c24ae0455'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:35.183477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b705a5c39d46b7a340343c24ae0455'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:35.256345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 830/1650] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:34 2022] DELETE /identity/v3/users/f1b705a5c39d46b7a340343c24ae0455 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:35.262974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.267063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.267063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.354407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:35.361459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:35.535554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 821/1651] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:35.579431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:35.580994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:35.712305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4355d3-3bfa-46ce-8bf1-b02da73edb46 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:35.721186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:35.727173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:35.727173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:35.727173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:35.734879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:35.736528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:35.761077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 831/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:36.955463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:36.958226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:36.979708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48b2ea-2ca3-4710-bf08-3f24fbf71ed6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:36.991248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:36.995084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:36.995895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:36.996402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] PATH_INFO: `/v3/projects/1f01b648becc418083f273214c7b01ae` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:37.001352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f01b648becc418083f273214c7b01ae)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:37.009776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: WARNING py.warnings [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:21:37.009776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: warnings.warn(msg) Aug 17 20:21:37.009776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: Aug 17 20:21:37.010766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:37.255363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:37.262655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:37.308760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674fbe-ba1d-420d-b2f7-290c6e75063b service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:37.324071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:37.325099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:37.325589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:37.326725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] PATH_INFO: `/v3/projects/8a649c4f81ca474590d411b112cdbe3b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:37.328898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a649c4f81ca474590d411b112cdbe3b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:37.349164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:37.450363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f01b648becc418083f273214c7b01ae', 'request_id': 'req-bb706999-d546-4087-8635-79201890f6cf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.598487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f01b648becc418083f273214c7b01ae', 'request_id': 'req-bb706999-d546-4087-8635-79201890f6cf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.681922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:37.685264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a649c4f81ca474590d411b112cdbe3b', 'request_id': 'req-4988b392-e775-448f-9616-c520408972d7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.710524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a649c4f81ca474590d411b112cdbe3b', 'request_id': 'req-4988b392-e775-448f-9616-c520408972d7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.733138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f01b648becc418083f273214c7b01ae', 'request_id': 'req-bb706999-d546-4087-8635-79201890f6cf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.757091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] The token cache is being invalidate because project 1f01b648becc418083f273214c7b01ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:37.757722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.763558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bb706999-d546-4087-8635-79201890f6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.779691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 822/1653] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:36 2022] DELETE /identity/v3/projects/1f01b648becc418083f273214c7b01ae => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:37.781635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:37.781916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:37.782350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:37.836996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a649c4f81ca474590d411b112cdbe3b', 'request_id': 'req-4988b392-e775-448f-9616-c520408972d7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.843574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:37.846706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:37.912659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] The token cache is being invalidate because project 8a649c4f81ca474590d411b112cdbe3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:37.913581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.924829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:37.927500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 832/1654] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:37 2022] DELETE /identity/v3/projects/8a649c4f81ca474590d411b112cdbe3b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:37.954634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:37.961915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:37.972090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:38.115313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 823/1655] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:38.120209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:38.120854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:38.151363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c907e69-dbc2-4190-8de3-941ff4159465 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:38.166049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:38.166726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:38.167012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:38.167287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] PATH_INFO: `/v3/projects/58c323c9a3fd44178ac692ca801de9d3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:38.168598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c323c9a3fd44178ac692ca801de9d3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:38.178391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:38.195980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988b392-e775-448f-9616-c520408972d7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:38.209743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:38.210496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:38.210827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:38.211118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] PATH_INFO: `/v3/users/bb53d6bd855d4163a13a34d6207c6768` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:38.213715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb53d6bd855d4163a13a34d6207c6768)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:38.215861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:38.391054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c323c9a3fd44178ac692ca801de9d3', 'request_id': 'req-b423bbf6-441f-4279-9823-a16b8ed7254b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.406936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c323c9a3fd44178ac692ca801de9d3', 'request_id': 'req-b423bbf6-441f-4279-9823-a16b8ed7254b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.489361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c323c9a3fd44178ac692ca801de9d3', 'request_id': 'req-b423bbf6-441f-4279-9823-a16b8ed7254b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.511126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] The token cache is being invalidate because project 58c323c9a3fd44178ac692ca801de9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:38.511941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.527323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b423bbf6-441f-4279-9823-a16b8ed7254b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.528628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 824/1656] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:38 2022] DELETE /identity/v3/projects/58c323c9a3fd44178ac692ca801de9d3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:38.530970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be697-2632-471b-9c17-31e006364138 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:38.536524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be697-2632-471b-9c17-31e006364138 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:38.537363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4be697-2632-471b-9c17-31e006364138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:38.549245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb53d6bd855d4163a13a34d6207c6768'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.579016 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6c4be697-2632-471b-9c17-31e006364138 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:38.580442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6c4be697-2632-471b-9c17-31e006364138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:38.745324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb53d6bd855d4163a13a34d6207c6768'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.750244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb53d6bd855d4163a13a34d6207c6768'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.750244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb53d6bd855d4163a13a34d6207c6768'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.767239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:38.772895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 825/1657] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:38.773486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4be697-2632-471b-9c17-31e006364138 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:38.773969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb53d6bd855d4163a13a34d6207c6768'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:38.774983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6c4be697-2632-471b-9c17-31e006364138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:38.805824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4be697-2632-471b-9c17-31e006364138 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:38.834112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:38.834806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:38.835101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:38.839610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] PATH_INFO: `/v3/users/848d216d177e413c8f83fd94c833594c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:38.844061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848d216d177e413c8f83fd94c833594c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:38.857413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:38.857629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 833/1658] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:37 2022] DELETE /identity/v3/users/bb53d6bd855d4163a13a34d6207c6768 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:38.857629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:39.133143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a32af-858b-401e-9d0f-01e3f47a2024 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:39.158217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:39.158217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:39.158217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:39.158217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:39.158684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:39.158684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:39.159402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:39.207882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 834/1659] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:39.207882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:39.229573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83913d98-e3df-4981-8ae1-502ad185ed84 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:39.252952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:39.255146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:39.257397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:39.258359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:39.259829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:39.268679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:39.364957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848d216d177e413c8f83fd94c833594c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:39.441066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 835/1660] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:39 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:39.449324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:39.483291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848d216d177e413c8f83fd94c833594c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:39.487092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848d216d177e413c8f83fd94c833594c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:39.487092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848d216d177e413c8f83fd94c833594c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:39.524654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848d216d177e413c8f83fd94c833594c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:39.634974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 826/1661] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:38 2022] DELETE /identity/v3/users/848d216d177e413c8f83fd94c833594c => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:39.859329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b426-ac85-4de3-9fb6-512e2c328f7d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:40.215443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:40.216355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:40.216767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:40.217297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:40.219186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:40.222000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:40.426006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 836/1662] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:39 2022] POST /identity/v3/users => generated 286 bytes in 976 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:40.428528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:40.430374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:40.506202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f8a1c-99d6-4a3e-bc9e-5a29f61a6035 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:40.540609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:40.541988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:40.546707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:40.546707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:40.546707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:40.546707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:40.571383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 827/1663] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:40.577424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:40.592780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19105cd6-d6ed-4104-beeb-0b286b799b98 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:40.625945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:40.627487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:40.628267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:40.630867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:40.634187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:40.644522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e44b9-5b44-466d-8258-d60d2744f258 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:40.719534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 837/1664] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:40.725381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:40.784630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785cf35-d058-4e50-bb26-e44f88edc02d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:40.851572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:40.853309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:40.860277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:40.860277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] PATH_INFO: `/v3/projects/957116017f344fd5b34acec4ae4acc0a/users/6fe39e82aec24b83823e4b10f89cce37/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:40.963099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957116017f344fd5b34acec4ae4acc0a, user_id=6fe39e82aec24b83823e4b10f89cce37, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:40.975437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:40.989513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:41.064898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 828/1665] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:40 2022] PUT /identity/v3/projects/957116017f344fd5b34acec4ae4acc0a/users/6fe39e82aec24b83823e4b10f89cce37/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:41.084743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.085023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.085498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.151648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] MFA Rules not processed for user `6fe39e82aec24b83823e4b10f89cce37`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:41.153186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:41.269415 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 838/1666] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:41.278965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:41.463073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6618c0-a952-4293-8063-2be4514855d6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:41.469943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:41.470662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.470947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.471216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.471868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:41.474263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:41.582801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:41.586101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:41.596911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 829/1667] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:41 2022] POST /identity/v3/projects => generated 371 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:41.603130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:41.620068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d0b4-4431-415a-8b55-0dad495c5016 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:41.653451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:41.782062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:41.783524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.784201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.785219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] PATH_INFO: `/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.787833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e5abfc70924c5cb1f9c8fe72add9b9)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:41.794539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:41.800816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c22c5-b17c-49a2-9b25-e10e1013cc2a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:41.815202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:41.815913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:41.816236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:41.816523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:41.817192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:41.820694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.023331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 830/1668] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:41 2022] POST /identity/v3/users => generated 292 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:42.023331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.026204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:42.064813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c772a-b06d-43a7-a4f9-6678b8958a30 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.103111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e5abfc70924c5cb1f9c8fe72add9b9', 'request_id': 'req-f1705e93-c81d-4f89-9474-a6a3a83893cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.122339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e5abfc70924c5cb1f9c8fe72add9b9', 'request_id': 'req-f1705e93-c81d-4f89-9474-a6a3a83893cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.227904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e5abfc70924c5cb1f9c8fe72add9b9', 'request_id': 'req-f1705e93-c81d-4f89-9474-a6a3a83893cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.280269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] The token cache is being invalidate because project e5e5abfc70924c5cb1f9c8fe72add9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:42.282868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.286669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.305689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 839/1669] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:41 2022] DELETE /identity/v3/projects/e5e5abfc70924c5cb1f9c8fe72add9b9 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:42.305689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.319086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:42.343405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.347034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.347698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.348779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] PATH_INFO: `/v3/projects/979dabbdbab848f0ad53ef686aae15c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.351277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=979dabbdbab848f0ad53ef686aae15c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.361388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.373816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1705e93-c81d-4f89-9474-a6a3a83893cf admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.390190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.391519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.391799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.392103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.392843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.400736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba662e27-f7eb-4309-9717-127d0e5b59f4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.425659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 840/1670] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:42.429281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.429281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.429281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.478032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:42.478032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:42.498052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 841/1671] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:42.500045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.523492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae81bb-1a31-4e6d-aef7-2c8fb78ad869 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.535022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.536594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.537095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.537605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] PATH_INFO: `/v3/projects/e9f70e7bd6da47a5a99e992afd826111/users/41c624a0550448f0a62a361b7074da2b/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.576399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f70e7bd6da47a5a99e992afd826111, user_id=41c624a0550448f0a62a361b7074da2b, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.583833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f0616-4641-4d7f-963a-b8505e6b88e5 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.744834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 842/1672] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:42 2022] PUT /identity/v3/projects/e9f70e7bd6da47a5a99e992afd826111/users/41c624a0550448f0a62a361b7074da2b/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:42.746334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.751694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.752193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.789028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979dabbdbab848f0ad53ef686aae15c3', 'request_id': 'req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.806163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:42.807744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:42.830752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979dabbdbab848f0ad53ef686aae15c3', 'request_id': 'req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:42.933541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 843/1673] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:42.935010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.950424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c39661-a5fe-4790-a50f-0287e9797763 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:42.957786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:42.958750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:42.959174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:42.959554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:42.960792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:42.963200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:42.980938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 844/1674] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:42.982233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:42.988251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979dabbdbab848f0ad53ef686aae15c3', 'request_id': 'req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:43.024570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a72c4-1a93-4bb5-b202-9b5de94fdafa admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:43.034969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] The token cache is being invalidate because project 979dabbdbab848f0ad53ef686aae15c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:43.037454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:43.037985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:43.042082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 831/1675] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:42 2022] DELETE /identity/v3/projects/979dabbdbab848f0ad53ef686aae15c3 => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:43.044216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:43.048248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.053439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:43.054336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.054732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.055166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.056354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:43.056881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:43.063563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09eb049-8c5a-471b-80b5-a941f70d614b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:43.124621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 845/1676] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:43.127363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfd11-20f2-42b4-8604-e5aadcf8c70d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.127876 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfd11-20f2-42b4-8604-e5aadcf8c70d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.129992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfd11-20f2-42b4-8604-e5aadcf8c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.238566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-47fdfd11-20f2-42b4-8604-e5aadcf8c70d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:43.240738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-47fdfd11-20f2-42b4-8604-e5aadcf8c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.288034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 846/1677] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:43.291292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7ba8c-324f-45b6-b2e2-1a7b8d42fe6f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:43.301926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d51-0160-40d0-941c-022fd997a999 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.303908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:43.306314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d51-0160-40d0-941c-022fd997a999 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.306807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d51-0160-40d0-941c-022fd997a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.314320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:43.315059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.315535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.316234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] PATH_INFO: `/v3/projects/e9f70e7bd6da47a5a99e992afd826111/users/41c624a0550448f0a62a361b7074da2b/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.323216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f70e7bd6da47a5a99e992afd826111, user_id=41c624a0550448f0a62a361b7074da2b, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:43.326733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:43.355154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 832/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:43 2022] PUT /identity/v3/projects/e9f70e7bd6da47a5a99e992afd826111/users/41c624a0550448f0a62a361b7074da2b/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:43.366196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:43.366196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.413618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-64231d51-0160-40d0-941c-022fd997a999 None None] MFA Rules not processed for user `46b27047a70c437e8ff046a02a0db8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:43.415746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-64231d51-0160-40d0-941c-022fd997a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.596500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cb173-7265-4b87-ba39-1839fc21d9c6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:43.611969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:43.612788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.613075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.613374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.614069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:43.619340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3ff27-5b7a-411b-b19a-3e4f25ea268a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:43.716226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 847/1679] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:43.738853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.753593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.754464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.773813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 833/1680] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:43 2022] POST /identity/v3/projects => generated 399 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:43.776580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:43.781797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:43.782188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:43.793743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:43.797845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.821558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:43.889120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] MFA Rules not processed for user `41c624a0550448f0a62a361b7074da2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:43.891773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:43.951768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 848/1681] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:43.954291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:43.957321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:44.057569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 834/1682] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:44.058631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:44.083038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434003bf-1a2f-4765-86ba-bba7ad6b245a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:44.097058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:44.098361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:44.098942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:44.100043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:44.100826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:44.106019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:44.249225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 835/1683] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:44 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:44.267173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:44.344053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896404-218c-407b-9af9-b843b390bf83 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:44.366533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8a6e3-6935-4352-8d3a-c83d9f23d084 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:44.389387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:44.395900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:44.397687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:44.399419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:44.404051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:44.405796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:44.416258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:44.419349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:44.421869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:44.428029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:44.435003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:44.512524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 836/1684] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:44.526190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:44.537666 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:44.651172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:44.876111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:44.886754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:44.902832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75a1d-dbe7-408d-bf01-4ae14db98bc8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:44.939795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:44.940683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:44.941976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:44.941976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:44.955791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 849/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 1002 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:44.958409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:44.987237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:44.991486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.004056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad8fc-a965-4764-b062-9fa67595148c service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.027560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.034141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.035396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.037991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.042709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.046051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.047024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 837/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:45.049459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:45.088816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 850/1687] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:45.093826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:45.100230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d311-c6bb-4f69-bda6-21412b17e358 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.122651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c570b8-d379-404e-8eb2-79357749175d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.129918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.133599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.135456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.136215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.136577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.136729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.137260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.137781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.139059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.143256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.143570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.151882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.170426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 851/1688] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:45.176352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:45.232601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aa63-6775-4f93-a65e-ee7d2b6aef34 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.258286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.265406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.266239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.272036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] PATH_INFO: `/v3/projects/3bdf1b456dd144e6ab0d4c0fb0534f8e/users/4d418ac7944146d9a18b9245c074588e/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.354708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bdf1b456dd144e6ab0d4c0fb0534f8e, user_id=4d418ac7944146d9a18b9245c074588e, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.360800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.402296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 838/1689] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:45 2022] POST /identity/v3/projects => generated 409 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:45.411486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:45.480948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 852/1690] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:45 2022] PUT /identity/v3/projects/3bdf1b456dd144e6ab0d4c0fb0534f8e/users/4d418ac7944146d9a18b9245c074588e/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:45.494065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:45.510607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:45.643099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037cff0-e649-4503-8803-b6b26254e2df admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.653513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.653513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.653513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.655793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.661562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:45.746557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756c0ce-cea9-4a0c-9a9b-93d7c4af20bc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:45.825665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.827408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc7c75-4e98-4671-b5b8-4aaf52c07ef1 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.864478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 853/1691] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:45.868311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.869497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.871950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.939541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:45.940676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:45.941280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:45.941813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:45.946677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:45.949077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:45.966197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] MFA Rules not processed for user `4d418ac7944146d9a18b9245c074588e`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:45.967541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:46.056365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:46.128464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 839/1692] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:45 2022] POST /identity/v3/users => generated 305 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:46.130333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.150232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 854/1693] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:46.161914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.198866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801494b5-852b-42bb-9a2f-b64ff6c2b47f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.202330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d098be-2064-4a83-a3f1-c62cd84a5c9a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.222959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.223599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.223881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.224150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.225001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:46.227037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:46.228639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.229833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.230557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.230947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.232158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:46.244866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:46.300103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 840/1694] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:46.301705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.336151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c743-ab67-42ff-b1e1-cc8ea1ec96c0 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.352899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.353761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.354210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.356152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.357392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:46.363484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:46.393990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 841/1695] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:46.401832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.425643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b1d08-8117-4ccc-9008-077825aaec9e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.435287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.436333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.436807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.437286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] PATH_INFO: `/v3/projects/317f551dd97a4fed89ab4463f02982ff/users/acdbc9a9e32f48d0af4677bcc797567e/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.470680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317f551dd97a4fed89ab4463f02982ff, user_id=acdbc9a9e32f48d0af4677bcc797567e, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:46.503943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf0919-c3b2-42c4-aff3-673496040806 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:46.504371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 855/1696] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:46 2022] POST /identity/v3/projects => generated 401 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:46.506927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.662483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 842/1697] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:46 2022] PUT /identity/v3/projects/317f551dd97a4fed89ab4463f02982ff/users/acdbc9a9e32f48d0af4677bcc797567e/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:46.670305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.676025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.676025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.745581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] MFA Rules not processed for user `acdbc9a9e32f48d0af4677bcc797567e`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:46.747906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:46.771536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58298d78-07e5-401e-a7d6-68e2ff6090af admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:46.972663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 843/1698] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:46.979927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:46.997681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:46.998429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:46.998706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:46.998975 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:46.999619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.017289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.164520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 856/1699] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:46 2022] POST /identity/v3/users => generated 307 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:47.175870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.208163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a66f21-6007-4932-9c88-ef739fa5199b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:47.224179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:47.225597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.226376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.227103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.228602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.237597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.284288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 857/1700] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:47.292273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.347123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c4c3-899d-4300-8f23-f7ac5c5f8820 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:47.376733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:47.377686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.378700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.378877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7869a-d64e-4901-825f-cc51119c33ed None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:47.379018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] PATH_INFO: `/v3/projects/7b7b074b489248fe90aed653cfb8caf1/users/f746aa6d0ca24ed1b70de951fb9f5991/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.407249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:47.408923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:47.409512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:47.410041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:47.411200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.415130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.422825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:47.430194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7b074b489248fe90aed653cfb8caf1, user_id=f746aa6d0ca24ed1b70de951fb9f5991, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:47.445406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:47.676480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 858/1701] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:47 2022] PUT /identity/v3/projects/7b7b074b489248fe90aed653cfb8caf1/users/f746aa6d0ca24ed1b70de951fb9f5991/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:21:47.688026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.707077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 844/1702] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:46 2022] POST /identity/v3/projects => generated 409 bytes in 733 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:47.710791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:47.854053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:48.141684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885236a3-0f75-41de-b05e-031e94e73d2e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.142621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f78fe-b61d-467c-8a8d-11bd5a1ecfe4 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.165172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.166090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.175709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.175709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.175709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.175709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:48.176292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.179628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.180306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.183543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.183543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.206138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:48.303839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 859/1703] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 608 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:48.303839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:48.354708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734721a1-e94e-47da-ae31-9c897f5fab39 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.365362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 845/1704] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:47 2022] POST /identity/v3/users => generated 311 bytes in 654 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:48.367791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.368771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.369149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:48.369368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.369830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] PATH_INFO: `/v3/projects/7b7b074b489248fe90aed653cfb8caf1/users/f746aa6d0ca24ed1b70de951fb9f5991/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.375429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7b074b489248fe90aed653cfb8caf1, user_id=f746aa6d0ca24ed1b70de951fb9f5991, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.380619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66306859-ed9e-4118-87da-6cd0382f447f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:48.412320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6f581-153b-4c43-855a-570a1c5a3ed6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.431105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 860/1705] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:48 2022] PUT /identity/v3/projects/7b7b074b489248fe90aed653cfb8caf1/users/f746aa6d0ca24ed1b70de951fb9f5991/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:48.435697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.436055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.441672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.527347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] MFA Rules not processed for user `f746aa6d0ca24ed1b70de951fb9f5991`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:48.528636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:48.682329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.683572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.684089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.684589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.685445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.688239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05dfdd-6eae-494b-96df-bcb7d1a8badb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:48.733610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 846/1706] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:48.751343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.751612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.751939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.854646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 861/1707] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:48.855758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:48.894077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bea79-4863-4488-8712-9adb144bf855 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:48.896411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] MFA Rules not processed for user `f429ea829f45484587a09157e1793650`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:48.902816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:48.911465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:48.912692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:48.913364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:48.913759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] PATH_INFO: `/v3/projects/7f7288b8da584b23b47ee87771b679c4/users/0abdff9b68d04c62894701daaa0ea2b9/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:48.977579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7288b8da584b23b47ee87771b679c4, user_id=0abdff9b68d04c62894701daaa0ea2b9, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:48.981699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2fb3-e57e-4ff3-b382-dc6e8925d036 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:49.075997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 847/1708] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:49.077076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:49.309031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8e2e2-cc6d-459a-a944-52fc1163d731 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:49.309031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:49.309031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:49.309031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:49.322218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:49.339030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:49.340572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:49.379509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 862/1709] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:48 2022] PUT /identity/v3/projects/7f7288b8da584b23b47ee87771b679c4/users/0abdff9b68d04c62894701daaa0ea2b9/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:49.384253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1e1b-993e-4df0-9d0b-712748870ed7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:49.384253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1e1b-993e-4df0-9d0b-712748870ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:49.384253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a1e1b-993e-4df0-9d0b-712748870ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:49.396264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 848/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:49 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:49.397383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:49.468213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e370721-4c18-4ca0-b6b0-900dc865611e service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:49.504616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7b5a1e1b-993e-4df0-9d0b-712748870ed7 None None] MFA Rules not processed for user `f429ea829f45484587a09157e1793650`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:49.514214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7b5a1e1b-993e-4df0-9d0b-712748870ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:49.726846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:50.035064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 863/1711] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 655 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:50.038806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.040919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.042056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:50.042714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.042995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.050919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.054489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.066807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:50.081376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:50.124653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 849/1712] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 727 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:50.125255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:50.135580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:50.151733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:50.204874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] MFA Rules not processed for user `0705d79d87ee4adc913a4266c2f3139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:50.206553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:50.436598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527f47-8124-4328-a6c2-f38d44d74edf admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:50.454644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:50.460827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.460827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.460827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.465652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 864/1713] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:50.469151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:50.477197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:50.479220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c468-eb2c-43d8-834c-38de08c53605 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:50.504303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed442e-bc94-4933-9c49-27404343b758 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:50.520048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:50.520755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 850/1714] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:50.521098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.521385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.521664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] PATH_INFO: `/v3/projects/7f7288b8da584b23b47ee87771b679c4/users/0abdff9b68d04c62894701daaa0ea2b9/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.523958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7288b8da584b23b47ee87771b679c4, user_id=0abdff9b68d04c62894701daaa0ea2b9, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:50.527158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:50.585761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0314-e7e2-4e96-a8f6-5c7ddb1862ef None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.586118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0314-e7e2-4e96-a8f6-5c7ddb1862ef None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.586398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc0314-e7e2-4e96-a8f6-5c7ddb1862ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:50.606245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 865/1715] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:50 2022] PUT /identity/v3/projects/7f7288b8da584b23b47ee87771b679c4/users/0abdff9b68d04c62894701daaa0ea2b9/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:50.608763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:50.625646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:50.703420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-00dc0314-e7e2-4e96-a8f6-5c7ddb1862ef None None] MFA Rules not processed for user `0705d79d87ee4adc913a4266c2f3139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:50.704734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-00dc0314-e7e2-4e96-a8f6-5c7ddb1862ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:50.919374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 851/1716] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:50.927454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:50.929579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:50.930083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:51.068320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] MFA Rules not processed for user `0abdff9b68d04c62894701daaa0ea2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:51.069589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:51.131841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff9e0a-710d-4cb8-8207-bfccb5fd828c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:51.185197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:51.187076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:51.195472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:51.196320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:51.351190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 852/1717] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:50 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:51.368477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:51.564883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:51.576309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:51.633360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 866/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 1026 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:51.647033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:51.691955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a17b0-9adc-4ce5-8fda-13d7d2f3236a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:51.699455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90b889-4f5e-4938-a55d-03669c35c4b8 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:51.716964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:51.718483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:51.719178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:51.719831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:51.730793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:51.747519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:51.752109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:51.752109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:51.752109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:51.752487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:51.801005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 853/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:51.807700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:51.810822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6a2b-ebd7-4f9a-a5c5-9c06f128595d service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:51.867325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:51.886272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 867/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:51 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:52.284622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:52.288416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:52.505722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f30be-3565-4807-bf5c-832aae9336f0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.507254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f30be-3565-4807-bf5c-832aae9336f0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.507770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f30be-3565-4807-bf5c-832aae9336f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:52.573195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:52.626320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-212f30be-3565-4807-bf5c-832aae9336f0 None None] MFA Rules not processed for user `2e9acd97be994f3ca7e36732f28470c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:52.638878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-212f30be-3565-4807-bf5c-832aae9336f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:52.650070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4ebb-9622-4ef0-8cc5-e4988072956d service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:52.673007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:52.673649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.673950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.681657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] PATH_INFO: `/v3/users/0232d9581aa648038448830511db9efc` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:52.687249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0232d9581aa648038448830511db9efc)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:52.692379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:52.893547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 868/1721] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:52.898997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526ea29-7710-4363-96d1-642d4a077e02 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.899445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526ea29-7710-4363-96d1-642d4a077e02 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.899816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526ea29-7710-4363-96d1-642d4a077e02 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:52.902277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 869/1722] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 17 20:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:21:52.917718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:52.918796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:52.919357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.065427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:53.071001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.080253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0232d9581aa648038448830511db9efc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.229355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 870/1723] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:53.241115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0232d9581aa648038448830511db9efc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.245805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0232d9581aa648038448830511db9efc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.245805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0232d9581aa648038448830511db9efc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.260444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39e6b075-8c41-435b-bda8-6621a9787e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0232d9581aa648038448830511db9efc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:53.292468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.294225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.315040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 854/1724] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:21:52 2022] DELETE /identity/v3/users/0232d9581aa648038448830511db9efc => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:53.318465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e328-644f-4880-b064-542a26cf65c7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.328417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e328-644f-4880-b064-542a26cf65c7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.328417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1e328-644f-4880-b064-542a26cf65c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.356403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1b44-ba6f-4b26-9a50-5ac2d5397907 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.373282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-21d1e328-644f-4880-b064-542a26cf65c7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:53.374637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-21d1e328-644f-4880-b064-542a26cf65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.414563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.415202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.415489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.415761 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.417847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.429525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.431150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:53.447766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 871/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:53.448824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.450524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.520195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 855/1726] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:53.530945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.531305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.531584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.534243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 856/1727] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 17 20:21:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:53.537201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.543981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.546400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41c5c-00c3-4eeb-925a-dd5e66cb6ee1 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.554380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.555015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.555295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.556698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.564378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.595283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d459-d252-4ff9-9e35-e19b02708583 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.606717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.607351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.607634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.607911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.623060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.624543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f962c-a2f9-4fe5-a9bb-c7722aa8c9df service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:53.637273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 857/1728] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:53.639372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.639984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.640443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.693400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.698943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:53.700450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:53.708801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:53.732886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 858/1729] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:21:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:53.757200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 872/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:53.928332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:53.941935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96166d69-62ef-43d3-a9c1-a43af20fe58d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:53.952316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:53.952961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:53.953241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:53.953500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:53.974358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:53.975905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa7bc6-2a67-4efd-910c-b0a4f196cf49 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:54.012616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 859/1731] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:54.385609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:54.753608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:54.756228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.906888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1b0d4-4f48-4fae-abc2-9c3129f3f035 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.907437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1b0d4-4f48-4fae-abc2-9c3129f3f035 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.907513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1b0d4-4f48-4fae-abc2-9c3129f3f035 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.909631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 860/1732] 10.222.0.48 () {54 vars in 961 bytes} [Wed Aug 17 20:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:21:54.917505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.918923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.919054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3e2dd-4f7e-480f-b1c9-65d1e5051d01 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:54.919156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.928106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:54.928804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:54.929282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:54.929925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:54.934969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:54.952532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:54.954665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.136442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.138600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.152934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 861/1733] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Aug 17 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:55.183145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:55.184810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.193997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 873/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:55.240282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ecc03-bf0f-4f70-ba24-b5d372a92f80 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.248948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.250517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.279770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.284213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.285721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.286071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.298135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.300132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fcd09-ba24-410d-ab57-778d1a13c74e service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.320358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.321423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.324472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.324472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] PATH_INFO: `/v3/projects/3e837f789d43409b80a1b62383c72598` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.325637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e837f789d43409b80a1b62383c72598)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.329653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.329830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.335496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.361453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 862/1735] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:55.362622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:55.369006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:55.395536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee4bb5-53ea-4562-8984-8968b82c969d service placement] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:55.404090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:55.405154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.405514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.405861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.437842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:55.444339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3783d8-4b71-4c72-b397-613d659e29aa service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:55.508174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 863/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:21:55.742929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e837f789d43409b80a1b62383c72598', 'request_id': 'req-fc9648d7-303a-4a51-b88b-efc531b1aae5'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.792986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e837f789d43409b80a1b62383c72598', 'request_id': 'req-fc9648d7-303a-4a51-b88b-efc531b1aae5'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:55.853714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d2cb-791f-4752-b044-01b6dc808267 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:55.854620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d2cb-791f-4752-b044-01b6dc808267 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:55.855082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65d2cb-791f-4752-b044-01b6dc808267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:55.887957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:55.929388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e837f789d43409b80a1b62383c72598', 'request_id': 'req-fc9648d7-303a-4a51-b88b-efc531b1aae5'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.008712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6a65d2cb-791f-4752-b044-01b6dc808267 None None] MFA Rules not processed for user `0705d79d87ee4adc913a4266c2f3139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:56.012361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] The token cache is being invalidate because project 3e837f789d43409b80a1b62383c72598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:21:56.012882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.018508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6a65d2cb-791f-4752-b044-01b6dc808267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.025737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fc9648d7-303a-4a51-b88b-efc531b1aae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:21:56.032108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 874/1737] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:21:55 2022] DELETE /identity/v3/projects/3e837f789d43409b80a1b62383c72598 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:56.041340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09986a0-43a9-481f-890b-a45ccff6e5d8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.041841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09986a0-43a9-481f-890b-a45ccff6e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.042373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09986a0-43a9-481f-890b-a45ccff6e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.154373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f09986a0-43a9-481f-890b-a45ccff6e5d8 None None] MFA Rules not processed for user `46b27047a70c437e8ff046a02a0db8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:56.167306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f09986a0-43a9-481f-890b-a45ccff6e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.251727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 864/1738] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:56.257387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.258267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.258949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.322308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:56.338030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.380250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 875/1739] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:56.591527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.592018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 865/1740] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:56.592151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.592431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.628305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:56.631743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:56.650603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 876/1741] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:21:56.657261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.672536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce0e48-6850-4f40-839b-fd630e2b8374 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.678945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.679828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.680279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.680733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.681618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:21:56.682125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.685520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.713687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:56.727044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 866/1742] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:21:56.729071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade645-1ab4-46b8-a5c5-b04600a5855c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:56.758595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:56.761776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:56.763479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:56.764138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:56.765345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:56.789043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:56.986167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 877/1743] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/projects => generated 405 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:21:56.991808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.068992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2918fc-ea57-4c3e-a970-4f799aedd30b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.275458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.276126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.276416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.276695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.277355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.290055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.303079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:57.505649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.515976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 867/1744] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:21:56 2022] POST /identity/v3/users => generated 303 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:21:57.525135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954928e-31dd-4dda-9dd9-6925171844be admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.538709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.539677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.540134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.540417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.541111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.545268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.572490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 878/1745] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:21:57.589567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.636330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759e5e1-577c-4f8c-9441-2ce3aa205d5b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.655755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.657540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.658826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.659681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.664151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.668085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7805ee-1887-4931-a8d5-8cd1f0259240 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:57.728649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 868/1746] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:21:57.732686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:57.769693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228548-9e71-4c2c-bbd9-8750716c3308 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:57.784520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:57.786500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:57.787348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:57.788297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] PATH_INFO: `/v3/projects/346aded2f1a84c108a0935c0d74aeaa1/users/36e0b95aee3a489c9499809de5096168/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:57.835112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=346aded2f1a84c108a0935c0d74aeaa1, user_id=36e0b95aee3a489c9499809de5096168, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:57.835112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:58.086560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 879/1747] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:21:57 2022] PUT /identity/v3/projects/346aded2f1a84c108a0935c0d74aeaa1/users/36e0b95aee3a489c9499809de5096168/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:21:58.097940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd494-e1a8-4c43-93e8-f4415b8e8ceb None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.098570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd494-e1a8-4c43-93e8-f4415b8e8ceb None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.098570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd494-e1a8-4c43-93e8-f4415b8e8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.124153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b04bd494-e1a8-4c43-93e8-f4415b8e8ceb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:21:58.125436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b04bd494-e1a8-4c43-93e8-f4415b8e8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:58.271214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 869/1748] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:21:58.285532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:21:58.294761 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:21:58.631089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94c4bc-d689-428d-9dca-7fa5a134cc4b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:21:58.658192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:21:58.659149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:21:58.659600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:21:58.665288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:21:58.690451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:58.696697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:21:58.707815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:21:58.760847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 880/1749] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:00.332626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:01.899341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f0168-224f-428d-8c99-1aa475631dd8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:01.900191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f0168-224f-428d-8c99-1aa475631dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:01.900191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f0168-224f-428d-8c99-1aa475631dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:01.945811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-817f0168-224f-428d-8c99-1aa475631dd8 None None] MFA Rules not processed for user `2e9acd97be994f3ca7e36732f28470c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:01.956783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-817f0168-224f-428d-8c99-1aa475631dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.027532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:02.110259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.112096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.146620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8024ce-74c4-4257-a673-a6ffbed07279 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.207753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.208304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.208586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.208858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] PATH_INFO: `/v3/users/4d418ac7944146d9a18b9245c074588e` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.214865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d418ac7944146d9a18b9245c074588e)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.219002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.355283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 870/1750] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:02.400424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.401395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.402456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.585135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] MFA Rules not processed for user `36e0b95aee3a489c9499809de5096168`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:02.586771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:02.671972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:02.744593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d418ac7944146d9a18b9245c074588e'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.863042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 871/1751] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:02.867444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:02.884641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7599e-1b98-47ec-ad21-f4fec9f8f77a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:02.890839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:02.891798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.892361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.892709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.893600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:02.896467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:02.907294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d418ac7944146d9a18b9245c074588e'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.908168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d418ac7944146d9a18b9245c074588e'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.909130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d418ac7944146d9a18b9245c074588e'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.917335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-67ffafca-121a-43b3-b130-b796f40cd1ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d418ac7944146d9a18b9245c074588e'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:02.950920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 881/1752] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:02 2022] DELETE /identity/v3/users/4d418ac7944146d9a18b9245c074588e => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:02.955503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:02.955786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:02.956196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:02.998842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:03.000436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:03.145190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 872/1753] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/projects => generated 405 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:03.149832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.154683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:03.189286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 882/1754] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:03.215239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.218333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:03.310294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbee90a-99ae-4bf3-8893-49e19308f365 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.317423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.318357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.318792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.319786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.320627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.324167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.455150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d9eab-d904-48bb-b173-cd66016aa1a9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.535472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.536106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.536391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.541398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.559328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.562400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.577698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 883/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:03.612702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 873/1756] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:03 2022] POST /identity/v3/users => generated 309 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:03.631395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.668551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7d76b-ebb0-497c-ad3d-012a6c1fd497 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.690469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.691372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.691666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.692047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.693409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.695901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:03.708653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 884/1757] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:03.713746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:03.724823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07947e0e-5550-4859-95f7-fc80cfc54434 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:03.750628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:03.751357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:03.751647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:03.751929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] PATH_INFO: `/v3/projects/4ea44db7e3c1443ba5129239a63307e8/users/a64a5a1be02f449892971f474138fc01/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:03.827506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea44db7e3c1443ba5129239a63307e8, user_id=a64a5a1be02f449892971f474138fc01, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:03.842273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.021536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 874/1758] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:03 2022] PUT /identity/v3/projects/4ea44db7e3c1443ba5129239a63307e8/users/a64a5a1be02f449892971f474138fc01/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:04.034737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.044163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0d5d1-a67f-4e78-8f88-60990c485116 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.204075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.207776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.208569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.217391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.219031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.223163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b1ad3-f066-4e95-a6b3-33d982cbb041 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.317143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:04.317681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 885/1759] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:04.338661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80b40c-003b-4c11-bd04-69b6b3895947 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:04.372379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:04.373085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:04.378296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:04.390307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] PATH_INFO: `/v3/projects/4ea44db7e3c1443ba5129239a63307e8/users/a64a5a1be02f449892971f474138fc01/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:04.408654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea44db7e3c1443ba5129239a63307e8, user_id=a64a5a1be02f449892971f474138fc01, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:04.425603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:04.481080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 875/1760] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:04 2022] PUT /identity/v3/projects/4ea44db7e3c1443ba5129239a63307e8/users/a64a5a1be02f449892971f474138fc01/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:04.640897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:05.008203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:05.008669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:05.016811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:05.167555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:05.188053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:05.355222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 886/1761] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:22:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:05.916688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:05.919644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:06.129978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e88713-ee5e-429a-9a35-dc1983ec2a4d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.138626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.140507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.146135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.146135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.158639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.161619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969cc5f-664e-4a86-8457-68e3482cb161 service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:06.188181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 876/1762] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:06.419445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:06.421234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:06.637051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd20bf-170a-4b49-9340-0bbd57051c28 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:06.647586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:06.648688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:06.649297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:06.649715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] PATH_INFO: `/v3/projects/3bdf1b456dd144e6ab0d4c0fb0534f8e` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:06.651216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bdf1b456dd144e6ab0d4c0fb0534f8e)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:06.654797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:07.107985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bdf1b456dd144e6ab0d4c0fb0534f8e', 'request_id': 'req-bf59fb13-df2c-4f32-9f3d-badc63455581'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.107985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bdf1b456dd144e6ab0d4c0fb0534f8e', 'request_id': 'req-bf59fb13-df2c-4f32-9f3d-badc63455581'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.409847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:07.410536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:07.410536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:07.492944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:07.496779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:07.590894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bdf1b456dd144e6ab0d4c0fb0534f8e', 'request_id': 'req-bf59fb13-df2c-4f32-9f3d-badc63455581'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.613964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] The token cache is being invalidate because project 3bdf1b456dd144e6ab0d4c0fb0534f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:07.614270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.619372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:07.626999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 887/1763] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:06 2022] DELETE /identity/v3/projects/3bdf1b456dd144e6ab0d4c0fb0534f8e => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:07.631252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:07.633515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:07.633744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 877/1764] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Aug 17 20:22:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:07.646575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:07.651384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:07.686677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a4f7-64e3-4a58-9b8f-c6ece19a7bb1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:07.700626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:07.701528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:07.702002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:07.702381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:07.717774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:07.735483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:07.764451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 878/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:07.859463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59fb13-df2c-4f32-9f3d-badc63455581 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:07.879013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:07.883403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:07.885996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:07.885996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] PATH_INFO: `/v3/users/f746aa6d0ca24ed1b70de951fb9f5991` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:07.894606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f746aa6d0ca24ed1b70de951fb9f5991)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:07.918384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.426770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f746aa6d0ca24ed1b70de951fb9f5991'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.502809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:08.505100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:08.520902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:08.554828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fdbcb-b416-4a58-8632-e000ce5f4201 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:08.564499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:08.565457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:08.566731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:08.572738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] PATH_INFO: `/v3/users/acdbc9a9e32f48d0af4677bcc797567e` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:08.572738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdbc9a9e32f48d0af4677bcc797567e)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:08.575758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:08.608552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f746aa6d0ca24ed1b70de951fb9f5991'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.611063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f746aa6d0ca24ed1b70de951fb9f5991'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.619234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f746aa6d0ca24ed1b70de951fb9f5991'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.643241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e8f1674c-9bcc-4f17-9f01-cfee398a41d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f746aa6d0ca24ed1b70de951fb9f5991'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:08.730640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 888/1766] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:07 2022] DELETE /identity/v3/users/f746aa6d0ca24ed1b70de951fb9f5991 => generated 0 bytes in 1100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:08.967954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdbc9a9e32f48d0af4677bcc797567e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.082674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdbc9a9e32f48d0af4677bcc797567e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.085154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdbc9a9e32f48d0af4677bcc797567e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.086667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdbc9a9e32f48d0af4677bcc797567e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.141203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdbc9a9e32f48d0af4677bcc797567e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:09.264397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d5402-575d-4cf2-8d8b-5462b7c20b4b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:09.264933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d5402-575d-4cf2-8d8b-5462b7c20b4b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:09.265401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d5402-575d-4cf2-8d8b-5462b7c20b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:09.270732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 879/1767] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:08 2022] DELETE /identity/v3/users/acdbc9a9e32f48d0af4677bcc797567e => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:09.301989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-658d5402-575d-4cf2-8d8b-5462b7c20b4b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:09.309203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-658d5402-575d-4cf2-8d8b-5462b7c20b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:09.318165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:09.417433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 889/1768] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:09.440991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:09.444144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:09.545145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40be2c4-54ee-40f5-a6cd-1d80a02d652b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:09.552094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:09.554024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:09.554606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:09.555123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:09.572774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:09.576097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac35bb-a008-4693-91f2-4d28834e6484 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:09.592312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 880/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:10.354450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.355439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.355439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:10.356516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 890/1770] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:22:10.420145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b616f-6ed9-49fe-9fe5-85bbfed6ab5c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:10.420420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b616f-6ed9-49fe-9fe5-85bbfed6ab5c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:10.420857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b616f-6ed9-49fe-9fe5-85bbfed6ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:10.482097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9f1b616f-6ed9-49fe-9fe5-85bbfed6ab5c None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:10.497552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9f1b616f-6ed9-49fe-9fe5-85bbfed6ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:10.796187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 881/1771] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:22:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:10.989050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:10.994544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.017122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b762d21-1901-4279-833d-df68e7401a25 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.024326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.036700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.036700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.036700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.044532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:11.047112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:11.065510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 891/1772] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:11.536158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8385e6-770b-4716-aa69-d86947c22fa7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.536589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8385e6-770b-4716-aa69-d86947c22fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.536919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8385e6-770b-4716-aa69-d86947c22fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.640552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8e8385e6-770b-4716-aa69-d86947c22fa7 None None] MFA Rules not processed for user `a64a5a1be02f449892971f474138fc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:11.653386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8e8385e6-770b-4716-aa69-d86947c22fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.834293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 882/1773] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:11 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:11.942568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:11.949824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:11.963966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff2f3d-edc5-4ec1-9f66-f19fd258277f service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:11.983365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:11.990166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:11.990166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:11.990166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] PATH_INFO: `/v3/projects/7b7b074b489248fe90aed653cfb8caf1` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:11.990166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7b074b489248fe90aed653cfb8caf1)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.001435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:12.323371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7b074b489248fe90aed653cfb8caf1', 'request_id': 'req-2635aa71-40e1-4d5c-a2ff-67dbb5703893'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.342076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7b074b489248fe90aed653cfb8caf1', 'request_id': 'req-2635aa71-40e1-4d5c-a2ff-67dbb5703893'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.444098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7b074b489248fe90aed653cfb8caf1', 'request_id': 'req-2635aa71-40e1-4d5c-a2ff-67dbb5703893'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.496248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] The token cache is being invalidate because project 7b7b074b489248fe90aed653cfb8caf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:12.496841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.498141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2635aa71-40e1-4d5c-a2ff-67dbb5703893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:12.507407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 892/1774] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:11 2022] DELETE /identity/v3/projects/7b7b074b489248fe90aed653cfb8caf1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:12.513066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.513486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.513860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.559226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:12.564378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:12.566268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.736757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 883/1775] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:12.748131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.749007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.759280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.847198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:12.850798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:12.877120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 893/1776] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:12.877750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:12.911088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9c900-7486-4ffe-a15a-7b912deb7de7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:12.943517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:12.945575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:12.946076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:12.948761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:12.950582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:12.951127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:12.953920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.018355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 884/1777] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:13.020334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.043060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d92e0-0690-459c-8c12-977129bddb11 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.049228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.050239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.050695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.051222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.052084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.054510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.156676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:13.215629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 894/1778] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:13 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:13.216791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.271694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0e770-0d66-4d7c-b860-e61ed7b8806a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.440892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.441707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.441978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.442259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.444868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.445059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.477493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.481032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:13.520179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c2ee5-27cc-4640-af89-598d117b81bb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.535657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.539054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.539516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.540572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] PATH_INFO: `/v3/projects/317f551dd97a4fed89ab4463f02982ff` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.543645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317f551dd97a4fed89ab4463f02982ff)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.551218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.598227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 885/1779] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:13 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:13.604863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.643646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c088-b228-4418-8531-9951fb5908e2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.652737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.653700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.654183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.654746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.655722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.668128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.693786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 886/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:13.698705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.716821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df231fb-64d4-4dfa-8d98-cec1d1efe22b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.737046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.737046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.737046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.737046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.737848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.740019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.762631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 887/1781] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:13.773982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:13.803769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84406e-c9e2-4124-8875-e2a4b2fa08f4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:13.819031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:13.819796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:13.820141 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:13.820423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] PATH_INFO: `/v3/projects/f7f981fc526e4ab587b5289a099bc0c3/users/9f3823f78db046a2a4a024fc2bbf5272/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:13.854313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f981fc526e4ab587b5289a099bc0c3, user_id=9f3823f78db046a2a4a024fc2bbf5272, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:13.870913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07beb-65e3-435f-9d71-9a29a55dda22 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:13.871017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317f551dd97a4fed89ab4463f02982ff', 'request_id': 'req-be2dc9ef-2756-4974-9387-e4e7c2a50b85'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:13.881652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317f551dd97a4fed89ab4463f02982ff', 'request_id': 'req-be2dc9ef-2756-4974-9387-e4e7c2a50b85'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.004364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 888/1782] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:13 2022] PUT /identity/v3/projects/f7f981fc526e4ab587b5289a099bc0c3/users/9f3823f78db046a2a4a024fc2bbf5272/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:14.028179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317f551dd97a4fed89ab4463f02982ff', 'request_id': 'req-be2dc9ef-2756-4974-9387-e4e7c2a50b85'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.032703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.038615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.040177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.074911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] The token cache is being invalidate because project 317f551dd97a4fed89ab4463f02982ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:14.075631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.077439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.088438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 895/1783] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:13 2022] DELETE /identity/v3/projects/317f551dd97a4fed89ab4463f02982ff => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:14.092164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:14.094070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.163396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] MFA Rules not processed for user `9f3823f78db046a2a4a024fc2bbf5272`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:14.166979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.243782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc9ef-2756-4974-9387-e4e7c2a50b85 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.363234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.367374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.367374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.367374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] PATH_INFO: `/v3/users/0abdff9b68d04c62894701daaa0ea2b9` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.370578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abdff9b68d04c62894701daaa0ea2b9)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.375033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 889/1784] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:14.376612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:14.378410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.382517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:14.440974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e91ff-33d2-4eb5-bd16-d2f752518422 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.454291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.455867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.459599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.460143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.461421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.468267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.488964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:14.727736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 890/1785] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:14 2022] POST /identity/v3/projects => generated 379 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:14.743147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:14.773449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abdff9b68d04c62894701daaa0ea2b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.885229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a180fd-69ad-4445-89f3-b5a5ec137a95 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:14.889612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abdff9b68d04c62894701daaa0ea2b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.889612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abdff9b68d04c62894701daaa0ea2b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.889866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abdff9b68d04c62894701daaa0ea2b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.907040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abdff9b68d04c62894701daaa0ea2b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:14.914033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:14.914705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:14.915059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:14.915405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:14.916052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:14.922656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:14.961091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 896/1786] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:14 2022] DELETE /identity/v3/users/0abdff9b68d04c62894701daaa0ea2b9 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:15.139122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.141528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:15.146897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 891/1787] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:14 2022] POST /identity/v3/users => generated 290 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:15.365276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4408ab-10ab-47bc-8872-e7e15495e42f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.376619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.378367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.391458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.393280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.398966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.407875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.465286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 897/1788] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:15.470467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.489124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d57c2-e58e-4052-88e0-8e0716fe230a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.495473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.496457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.496798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.498430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.499665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.502203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597919a-280d-474c-a0c1-5ad770bb7893 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.520122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 892/1789] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:15.528305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:15.590377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b07c7c-5aee-4de8-9394-68f38edb873c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:15.606203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:15.606203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.615809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.617029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] PATH_INFO: `/v3/projects/51bfad4d8abf43d7a41a4fb48b87faa1/users/a2ab533d4fc6429cbddcfac08055f874/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.618304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7e64-4e97-44e6-927b-80ef12a0daea None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.618473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7e64-4e97-44e6-927b-80ef12a0daea None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.618746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7e64-4e97-44e6-927b-80ef12a0daea None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.621038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 893/1790] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:22:15.671950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb9c5-aa14-43f0-9b3f-42d217617f93 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.676903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb9c5-aa14-43f0-9b3f-42d217617f93 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.676903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fb9c5-aa14-43f0-9b3f-42d217617f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.677288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bfad4d8abf43d7a41a4fb48b87faa1, user_id=a2ab533d4fc6429cbddcfac08055f874, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:15.685196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880fb31-9dfc-48ad-82f4-03518eef0a21 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:15.745617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6d1fb9c5-aa14-43f0-9b3f-42d217617f93 None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:15.751268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6d1fb9c5-aa14-43f0-9b3f-42d217617f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:15.855284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 898/1791] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:15 2022] PUT /identity/v3/projects/51bfad4d8abf43d7a41a4fb48b87faa1/users/a2ab533d4fc6429cbddcfac08055f874/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:15.858958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:15.859510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:15.859971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:15.961859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 894/1792] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:15.998598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] MFA Rules not processed for user `a2ab533d4fc6429cbddcfac08055f874`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:16.001040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.033316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.033623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.033953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.035927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 895/1793] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 20:22:16.114631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.116627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.355519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd4ab2-6929-43c2-96f0-17b4234ef366 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.371588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.372240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.372819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.372819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.395199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.397284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86cb01-a2ec-4759-84ac-423af39b79fb service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.420629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 896/1794] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:16.422749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.423045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.423318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.462422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 899/1795] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:16.468052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.470263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:16.471521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:16.656372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce6b45-930b-4799-a078-2e2029f1d77d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:16.666829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:16.672637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:16.674309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:16.676325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:16.678555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:16.680937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:16.694267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:16.722348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 897/1796] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:16.864141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 900/1797] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/projects => generated 377 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:16.869620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:16.917838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e36226-7871-4e0f-82e2-39df042af794 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.041413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.043176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.043576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.046363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.050964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.068073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.205605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.207941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:17.244654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 898/1798] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:16 2022] POST /identity/v3/users => generated 295 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:17.252919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.311608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235e220-48cb-45d7-8559-52b896c7b348 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.349027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.349975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.350223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.353746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.357095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.357095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.395228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 899/1799] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:17.395470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.399636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:17.424807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18983e2c-611b-4434-9d76-fc28b7e6a0ce admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.442193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6b47e-19f6-4153-b5f6-292b415f2670 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.442299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.442299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.447728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.448120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.451927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.452656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.457556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.457975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] PATH_INFO: `/v3/projects/7f7288b8da584b23b47ee87771b679c4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.462042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7288b8da584b23b47ee87771b679c4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.464496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.489183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.497836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.541262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 901/1800] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:17.546452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.574532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cc328-51db-4b3a-b9bd-8cdbfd1ebd11 service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.585182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.585182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.585448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.585565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] PATH_INFO: `/v3/projects/3edfa6791f104e32a31c78ab1534062a/users/a0e1ba8a2bb6409da2f5c6bef09eab0a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.627165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edfa6791f104e32a31c78ab1534062a, user_id=a0e1ba8a2bb6409da2f5c6bef09eab0a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.630024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.659267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7288b8da584b23b47ee87771b679c4', 'request_id': 'req-db12c034-d753-45ba-af83-5fccc22f7db7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:17.682373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7288b8da584b23b47ee87771b679c4', 'request_id': 'req-db12c034-d753-45ba-af83-5fccc22f7db7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:17.789397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 902/1801] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:17 2022] PUT /identity/v3/projects/3edfa6791f104e32a31c78ab1534062a/users/a0e1ba8a2bb6409da2f5c6bef09eab0a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:17.799060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:17.882337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7288b8da584b23b47ee87771b679c4', 'request_id': 'req-db12c034-d753-45ba-af83-5fccc22f7db7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:17.899163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] The token cache is being invalidate because project 7f7288b8da584b23b47ee87771b679c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:17.899824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:17.901259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-db12c034-d753-45ba-af83-5fccc22f7db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:17.904417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 900/1802] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:17 2022] DELETE /identity/v3/projects/7f7288b8da584b23b47ee87771b679c4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:17.914534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e99-b95f-447f-a24f-bdde33012da8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.916890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e99-b95f-447f-a24f-bdde33012da8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.925273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f95e99-b95f-447f-a24f-bdde33012da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.946871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9675d57-6873-425e-a169-30f89ddd2f23 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:17.963773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:17.967773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:17.967773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:17.967773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:17.967773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:17.968326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:17.984378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-48f95e99-b95f-447f-a24f-bdde33012da8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:17.985838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-48f95e99-b95f-447f-a24f-bdde33012da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.000525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 903/1803] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:18.002561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.008313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.009923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 901/1804] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:18.025493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.026198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.027531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.040656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7852-1afc-40fb-bc92-cbca4b3cfde1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.048629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.049545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.049737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.050123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] PATH_INFO: `/v3/projects/3edfa6791f104e32a31c78ab1534062a/users/a0e1ba8a2bb6409da2f5c6bef09eab0a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.052590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edfa6791f104e32a31c78ab1534062a, user_id=a0e1ba8a2bb6409da2f5c6bef09eab0a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.056608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b7984-f912-4749-9e35-9568389832e2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.060686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:18.062296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.081412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 904/1805] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:18 2022] PUT /identity/v3/projects/3edfa6791f104e32a31c78ab1534062a/users/a0e1ba8a2bb6409da2f5c6bef09eab0a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:18.083089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.083507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.083679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.122061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] MFA Rules not processed for user `a0e1ba8a2bb6409da2f5c6bef09eab0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:18.123470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.166831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 902/1806] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:18.169787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.177549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:18.191183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eecc3-3be1-4182-8214-844ae0d1c8dd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.198047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.199578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.200075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.200360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.201053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:18.201358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.205606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.220486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 903/1807] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:18.224532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.253258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba6473-16cf-467c-923f-9c36a3ddf1ad admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.274240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 905/1808] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:18.278598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.279685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.279768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.280052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.280713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.286775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.287190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.288674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.421030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:18.510966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d4491-cf9b-4bd7-b19a-e345cf8f18c9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.522829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.529089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.529374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.529699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.551795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.553479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.576451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 906/1809] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:18.597432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 904/1810] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:18 2022] POST /identity/v3/projects => generated 359 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:18.598033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.610900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a4427-5942-417f-bcd9-552e62137b97 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.764959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:18.839947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.840584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.840866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.841150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.841813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:18.844061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af682d2-4932-4d8f-b6c3-f813931b604f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:18.956794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e88b5-875a-4aa4-ae60-e706aeffeec8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:18.962508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:18.963184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.963493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.963732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:18.966439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:18.991260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 907/1811] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:18 2022] POST /identity/v3/users => generated 280 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:18.993602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455038b-e074-4dc7-b470-8c9327e4b11a None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:18.993900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455038b-e074-4dc7-b470-8c9327e4b11a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:18.994225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455038b-e074-4dc7-b470-8c9327e4b11a None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.000502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 908/1812] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:22:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:22:19.003679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455038b-e074-4dc7-b470-8c9327e4b11a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:19.061041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455038b-e074-4dc7-b470-8c9327e4b11a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:19.067521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:19.068585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.069142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.069696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.071848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.075546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.100594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 909/1813] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:19.103528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:19.117400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.119022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.133986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3006d-86bd-4125-ad10-29d195f25f52 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:19.144912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:19.146083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.146521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.147070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.149941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.153848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653191a2-2067-4b4a-a672-64c5283aacee admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.172575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 905/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:19.178001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 910/1815] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:19.180086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:19.193590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d01eb-c8a5-4911-a3ab-8e8c435bd600 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:19.196069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.196552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.197117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.218009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:19.219188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.225519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.226243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] PATH_INFO: `/v3/projects/db65796f4e73400ea5296bf36c0eaaca/users/df2fdbfe1fe54af895a4a92aaf8e69eb/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.261020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] MFA Rules not processed for user `7f4767886144473e95c3f3998461bd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:19.263509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:19.270213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db65796f4e73400ea5296bf36c0eaaca, user_id=df2fdbfe1fe54af895a4a92aaf8e69eb, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.276580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.428963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 911/1816] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:22:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:19.449049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:19.451361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:19.471141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5607c8-34ae-4cd5-bfda-a27fd2b707af None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:19.479329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:19.480074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.480874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.481364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.492116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.494216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c9afc-59d0-4397-baee-8e6e376da6a7 service placement] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.525388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 906/1817] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:19 2022] PUT /identity/v3/projects/db65796f4e73400ea5296bf36c0eaaca/users/df2fdbfe1fe54af895a4a92aaf8e69eb/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:19.526856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:19.543824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:19.552485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 912/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:19.573767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.574841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.575323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.673568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] MFA Rules not processed for user `df2fdbfe1fe54af895a4a92aaf8e69eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:19.676958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:19.786713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfedc8-1050-4821-bcff-34ae7aac2bd1 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:19.809033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:19.809706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:19.810045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:19.810325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] PATH_INFO: `/v3/users/36e0b95aee3a489c9499809de5096168` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:19.820616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e0b95aee3a489c9499809de5096168)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:19.826371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:19.892469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 913/1819] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:20.171200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e0b95aee3a489c9499809de5096168'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.252809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:20.254525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:20.264202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e0b95aee3a489c9499809de5096168'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.265152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e0b95aee3a489c9499809de5096168'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.266010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e0b95aee3a489c9499809de5096168'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.283914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e0b95aee3a489c9499809de5096168'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:20.347917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 907/1820] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:19 2022] DELETE /identity/v3/users/36e0b95aee3a489c9499809de5096168 => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:20.397749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a2b2f-2bea-44e6-a3d5-58a39a38ecd7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:20.610844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:20.657861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:20.660209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:20.662724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:20.666409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:20.675018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:20.951699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:20.956826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffc0e7-342a-466e-9338-177dceecafff service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:20.978436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 914/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:21.026953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:21.032462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:21.356941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611e0f4-efe0-45be-b416-7ebe528a3407 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:21.364928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:21.365647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:21.365961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:21.366242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] PATH_INFO: `/v3/users/df2fdbfe1fe54af895a4a92aaf8e69eb` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:21.367833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2fdbfe1fe54af895a4a92aaf8e69eb)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:21.370449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:21.729233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2fdbfe1fe54af895a4a92aaf8e69eb'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:21.894316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2fdbfe1fe54af895a4a92aaf8e69eb'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:21.895003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2fdbfe1fe54af895a4a92aaf8e69eb'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:21.896093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2fdbfe1fe54af895a4a92aaf8e69eb'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:21.911694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2fdbfe1fe54af895a4a92aaf8e69eb'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:21.954395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 908/1822] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:21 2022] DELETE /identity/v3/users/df2fdbfe1fe54af895a4a92aaf8e69eb => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:21.958674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:21.959358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:21.959358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:21.985157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:21.986423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.059259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 915/1823] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:22.070795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.073695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.178942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9d2c2-8cee-40db-bb4a-bc7cfdddebc4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.185522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.186476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.186760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.187634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.198785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.201424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:22.213966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 909/1824] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:22.234732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.236812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.264566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34224-6c27-4158-8868-2ca4e940a1c3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.282338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.285715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.285715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.285715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] PATH_INFO: `/v3/projects/346aded2f1a84c108a0935c0d74aeaa1` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.291012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346aded2f1a84c108a0935c0d74aeaa1)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.295378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:22.342917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:22.478723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346aded2f1a84c108a0935c0d74aeaa1', 'request_id': 'req-c1987f49-3eb4-4d32-92bf-1a56b110b015'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.486934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346aded2f1a84c108a0935c0d74aeaa1', 'request_id': 'req-c1987f49-3eb4-4d32-92bf-1a56b110b015'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.605450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346aded2f1a84c108a0935c0d74aeaa1', 'request_id': 'req-c1987f49-3eb4-4d32-92bf-1a56b110b015'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.623060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] The token cache is being invalidate because project 346aded2f1a84c108a0935c0d74aeaa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:22.623932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.624629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:22.626728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 916/1825] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:22 2022] DELETE /identity/v3/projects/346aded2f1a84c108a0935c0d74aeaa1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:22.630467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.642413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165a51-1ca8-4ce6-ba9b-401ed3473e07 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.739423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.740430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.740859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.741281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] PATH_INFO: `/v3/users/a64a5a1be02f449892971f474138fc01` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.742864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64a5a1be02f449892971f474138fc01)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.745085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:22.913560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:22.916548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:22.933818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1987f49-3eb4-4d32-92bf-1a56b110b015 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:22.940384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:22.940877 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:22.941162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:22.941433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] PATH_INFO: `/v3/projects/db65796f4e73400ea5296bf36c0eaaca` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:22.944754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db65796f4e73400ea5296bf36c0eaaca)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:22.947514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.046088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64a5a1be02f449892971f474138fc01'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.086943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db65796f4e73400ea5296bf36c0eaaca', 'request_id': 'req-3cb57b65-ad91-47e0-8f27-9254d136b477'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.094954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db65796f4e73400ea5296bf36c0eaaca', 'request_id': 'req-3cb57b65-ad91-47e0-8f27-9254d136b477'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.119781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64a5a1be02f449892971f474138fc01'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.120439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64a5a1be02f449892971f474138fc01'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.121061 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64a5a1be02f449892971f474138fc01'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.130009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8cc2251e-4071-45bf-82e7-1daaf09a54bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64a5a1be02f449892971f474138fc01'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.149191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 910/1826] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:22 2022] DELETE /identity/v3/users/a64a5a1be02f449892971f474138fc01 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:23.165312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:23.268526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db65796f4e73400ea5296bf36c0eaaca', 'request_id': 'req-3cb57b65-ad91-47e0-8f27-9254d136b477'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.284463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] The token cache is being invalidate because project db65796f4e73400ea5296bf36c0eaaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:23.284463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.285198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3cb57b65-ad91-47e0-8f27-9254d136b477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.290397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 917/1827] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:22 2022] DELETE /identity/v3/projects/db65796f4e73400ea5296bf36c0eaaca => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:23.292853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.293138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.293463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.314830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:23.316152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.391701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 911/1828] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:23.399151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.399503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.399869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.426235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:23.427579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.438585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 918/1829] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:23.443809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.454524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79440d-2e9f-4476-889e-02daba8d8c07 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.460257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.460893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.461345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.461619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.462296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:23.462587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.464251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.481935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 912/1830] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:23.491019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.493554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.496624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.509947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac1398-20a7-4c9a-b539-7ae2c6f5838c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.521324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.522468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.522960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.523211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872bed2-5b65-48d0-b650-be401daefb39 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.523587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.524721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.530180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.533229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.533642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.533642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.533642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] PATH_INFO: `/v3/projects/4ea44db7e3c1443ba5129239a63307e8` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.533642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea44db7e3c1443ba5129239a63307e8)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.535249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.655690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 919/1831] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:23.659942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.732562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea44db7e3c1443ba5129239a63307e8', 'request_id': 'req-8eeadb0a-1a76-4a03-a101-5d686defcf5d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.740895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea44db7e3c1443ba5129239a63307e8', 'request_id': 'req-8eeadb0a-1a76-4a03-a101-5d686defcf5d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.749340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9d07a-ce18-4906-8dba-c6c4d55793ac admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.829560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea44db7e3c1443ba5129239a63307e8', 'request_id': 'req-8eeadb0a-1a76-4a03-a101-5d686defcf5d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.836674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.837559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.837928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.838185 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.838894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.840905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.849833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] The token cache is being invalidate because project 4ea44db7e3c1443ba5129239a63307e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:23.850234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.851100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8eeadb0a-1a76-4a03-a101-5d686defcf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:23.858161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 913/1832] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:23 2022] DELETE /identity/v3/projects/4ea44db7e3c1443ba5129239a63307e8 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:23.862632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b595-7fc1-47d9-bc57-56557b057d10 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.862924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b595-7fc1-47d9-bc57-56557b057d10 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.863202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451b595-7fc1-47d9-bc57-56557b057d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.886211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3451b595-7fc1-47d9-bc57-56557b057d10 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:23.887445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3451b595-7fc1-47d9-bc57-56557b057d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.897176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 914/1833] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:23.913310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.913310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.913310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.929274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:23.932066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:23.940783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 915/1834] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:23.944970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:23.958504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872f48-12bb-4a48-8b3d-ad5b63e46283 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:23.963971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:23.964616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:23.964898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:23.965170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:23.965859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:23.966185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:23.967807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:23.992209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 916/1835] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:23.996808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.008383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51bf17-0a6e-4eaa-8003-b06dbe8ad308 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.013983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.014754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.015027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.015302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.015934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.018064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.030721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 920/1836] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/users => generated 292 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:24.036281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.038699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.051287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782e783-ac8b-4091-a487-5896cff9519f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.056540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.057053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.057454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.057654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.058287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.060422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.073687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 921/1837] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:24.078767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.089651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec628-10d0-4448-bb71-49e799cefe19 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.097128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.097478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.097574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.097797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.098629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.100317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.118744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 922/1838] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:24.118744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.137189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d777-e9bf-42bd-acf5-b959a4c19873 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.141854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 917/1839] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:23 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:24.145423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.146307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.146459 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.146967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.147372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] PATH_INFO: `/v3/projects/fdc9d70df6f247718110dc1efd14d70a/users/676ffc10fc234d0db518c72c9cf41020/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.172577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc9d70df6f247718110dc1efd14d70a, user_id=676ffc10fc234d0db518c72c9cf41020, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.176603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b4d3-7311-42c5-bd62-624196f6e607 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.285653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a9031-4a28-49cd-9098-1c4bb1604c28 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.290747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 923/1840] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:24 2022] PUT /identity/v3/projects/fdc9d70df6f247718110dc1efd14d70a/users/676ffc10fc234d0db518c72c9cf41020/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:24.302966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.303494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.303840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.344376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] MFA Rules not processed for user `676ffc10fc234d0db518c72c9cf41020`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:24.345707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.379326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.380019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.380305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.380603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.381396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.383964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.454845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 924/1841] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:24.520795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.520795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:24.567802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 918/1842] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/users => generated 284 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:24.572094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.585949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a4662-89ad-4c7d-838c-39be40c04a32 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.597020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.597656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.597999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.598282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.598950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.600645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.603635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543977f4-9fa6-4ab7-9f05-70bcbaf35e77 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.612847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.613582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.613989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.614267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.625921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 919/1843] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:24.626116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.627499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.630624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.640239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 925/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:24.644450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b55eb-dd27-4ec6-9772-2ed128a288a0 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.648987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.649714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.650055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.650332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.650998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.652655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a8999-f407-4163-b37a-7bef25eb5ecb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.665337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 920/1845] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:24.671537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:24.692898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df94fc7-c3ce-4f18-b460-84a2278c1a96 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:24.700778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:24.702172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.703245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.703808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] PATH_INFO: `/v3/projects/c0c073d9324849878142c439e3e7405b/users/76b28221135c423d96a4d659c142411c/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.734267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c073d9324849878142c439e3e7405b, user_id=76b28221135c423d96a4d659c142411c, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:24.739084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:24.853724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 926/1846] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:24 2022] PUT /identity/v3/projects/c0c073d9324849878142c439e3e7405b/users/76b28221135c423d96a4d659c142411c/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:24.869407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:24.870035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:24.870518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:24.917166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] MFA Rules not processed for user `76b28221135c423d96a4d659c142411c`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:24.918644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:25.019357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 921/1847] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:25.024091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.097014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086c142-355d-42b2-9ee6-33ef99f47897 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.102492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.103021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.103371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.103715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.104472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.106930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.263617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 927/1848] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:25 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:25.268816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.289136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fcd5a-9d3e-4201-abde-12bae31bb60d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.357153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.358011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.358292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.358561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.359193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.361171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.539264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 922/1849] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:25 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:25.543855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.554602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1761-d6b2-4dc8-b3cd-e67c46c09629 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.559425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.560541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.560840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.561091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.561943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.563577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.577473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 928/1850] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:25.581813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.625281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319abad-7b92-4f96-a803-80137052dbaa admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.630724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.631407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.631687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.631962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] PATH_INFO: `/v3/projects/9165996e515542d1b1f4ea5dc2b943bb/users/51cc70b08ea34b1db9f15bfa07bd4d3f/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.651872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9165996e515542d1b1f4ea5dc2b943bb, user_id=51cc70b08ea34b1db9f15bfa07bd4d3f, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.655335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.720605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:25.767428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 923/1851] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:25 2022] PUT /identity/v3/projects/9165996e515542d1b1f4ea5dc2b943bb/users/51cc70b08ea34b1db9f15bfa07bd4d3f/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:25.773316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.782120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a51152-f023-40e6-afde-ca8fe77dbb8d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.848815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.849686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.850225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.850708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.851650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.854138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc88abb-0fd8-46d8-84b2-0599ba7d9b89 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.875559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:25.876232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 929/1852] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:25.894501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c682d-b81a-4c83-983f-d9bdf97f91ad admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:25.901113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:25.901768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.904717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.904717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] PATH_INFO: `/v3/projects/9165996e515542d1b1f4ea5dc2b943bb/users/51cc70b08ea34b1db9f15bfa07bd4d3f/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.905455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9165996e515542d1b1f4ea5dc2b943bb, user_id=51cc70b08ea34b1db9f15bfa07bd4d3f, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:25.908179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:25.920970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 924/1853] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:25 2022] PUT /identity/v3/projects/9165996e515542d1b1f4ea5dc2b943bb/users/51cc70b08ea34b1db9f15bfa07bd4d3f/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:25.931649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:25.939204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:25.939204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:25.964380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] MFA Rules not processed for user `51cc70b08ea34b1db9f15bfa07bd4d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:25.965614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:26.057901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 930/1854] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:26.073994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:26.076127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:26.161980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a3d8-6693-43c7-b85d-90fdeaaa0cba admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:26.166641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:26.167296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:26.167582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:26.167856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:26.178551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:26.180023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:26.192984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 925/1855] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:26.553088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:26.563648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6827f-f56b-4cb0-97ae-446e2a1fd7d1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:26.567314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:26.568326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:26.568602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:26.568869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:26.634542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:26.636011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11917-6471-41fd-bd57-0c521aa45668 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:26.646366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 931/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:26.745917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:27.454979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:27.456742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:27.543248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b290-3868-4965-b30e-031b67e3b5c9 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:27.549148 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:27.549861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:27.550230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:27.550568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] PATH_INFO: `/v3/users/9f3823f78db046a2a4a024fc2bbf5272` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:27.551762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3823f78db046a2a4a024fc2bbf5272)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:27.553716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:28.600174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3823f78db046a2a4a024fc2bbf5272'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.778559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3823f78db046a2a4a024fc2bbf5272'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.779342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3823f78db046a2a4a024fc2bbf5272'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.780601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3823f78db046a2a4a024fc2bbf5272'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.804569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3823f78db046a2a4a024fc2bbf5272'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:28.831259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 926/1857] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:27 2022] DELETE /identity/v3/users/9f3823f78db046a2a4a024fc2bbf5272 => generated 0 bytes in 1377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:28.838085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:28.838772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:28.838772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:28.864297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:28.865691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:28.947034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 932/1858] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:28.958709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:28.961337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:29.087635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6477a-e406-4ccc-9824-808f71570dd7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:29.091648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:29.093044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:29.093350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:29.093631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:29.105727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:29.107240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:29.119669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 927/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:29.851201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:29.853069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:29.871827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbc478-49f5-44b3-9253-30c57e363b0a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:29.884217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:29.884217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:29.884217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:29.884217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] PATH_INFO: `/v3/users/676ffc10fc234d0db518c72c9cf41020` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:29.884668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=676ffc10fc234d0db518c72c9cf41020)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:29.884668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:29.987920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:29.990763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.021913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad949fb2-97e2-464b-b0be-7bbd7ea07a53 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.030412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.031108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.031395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.032184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] PATH_INFO: `/v3/projects/f7f981fc526e4ab587b5289a099bc0c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.033043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f981fc526e4ab587b5289a099bc0c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.035171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.266555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f981fc526e4ab587b5289a099bc0c3', 'request_id': 'req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.273938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676ffc10fc234d0db518c72c9cf41020'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.282748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f981fc526e4ab587b5289a099bc0c3', 'request_id': 'req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.328994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:30.361931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676ffc10fc234d0db518c72c9cf41020'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.362719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676ffc10fc234d0db518c72c9cf41020'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.363480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676ffc10fc234d0db518c72c9cf41020'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.374593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6c24e9ba-40e4-4b6a-8e2f-cee91b4af427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676ffc10fc234d0db518c72c9cf41020'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.396341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 933/1860] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:29 2022] DELETE /identity/v3/users/676ffc10fc234d0db518c72c9cf41020 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:30.402703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:30.421422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.421422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.421422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.434401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:30.435760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.459468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f981fc526e4ab587b5289a099bc0c3', 'request_id': 'req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.481931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] The token cache is being invalidate because project f7f981fc526e4ab587b5289a099bc0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:30.482665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.483517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:30.485165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 928/1861] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:29 2022] DELETE /identity/v3/projects/f7f981fc526e4ab587b5289a099bc0c3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:30.490287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.492482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.530578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 934/1862] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:30.539814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:30.541489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:30.607388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc81e-0f7a-4c75-8b4e-0586e4c4995a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.616144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.617274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.617774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.618301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] PATH_INFO: `/v3/users/a2ab533d4fc6429cbddcfac08055f874` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.620403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ab533d4fc6429cbddcfac08055f874)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.623577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86da32-304f-4d62-bbba-a93a2e046dd8 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:30.624990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.637564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:30.637948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:30.638821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:30.639068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:30.652874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:30.654396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:30.674312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 935/1863] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:30.938385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ab533d4fc6429cbddcfac08055f874'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.030785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ab533d4fc6429cbddcfac08055f874'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.033088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ab533d4fc6429cbddcfac08055f874'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.033926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ab533d4fc6429cbddcfac08055f874'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.045546 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-66012c4e-86e0-4de6-a099-3e5fbdceed43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ab533d4fc6429cbddcfac08055f874'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.076139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 929/1864] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:30 2022] DELETE /identity/v3/users/a2ab533d4fc6429cbddcfac08055f874 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:31.198201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.206493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.235366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c7d3b-58a5-42f9-bd2f-a4c482563588 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.358048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:31.358048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.358048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.358048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] PATH_INFO: `/v3/projects/fdc9d70df6f247718110dc1efd14d70a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.360580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc9d70df6f247718110dc1efd14d70a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:31.364874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:31.624077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc9d70df6f247718110dc1efd14d70a', 'request_id': 'req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.642452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc9d70df6f247718110dc1efd14d70a', 'request_id': 'req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.749651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc9d70df6f247718110dc1efd14d70a', 'request_id': 'req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.770338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] The token cache is being invalidate because project fdc9d70df6f247718110dc1efd14d70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:31.770656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.771367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:31.775236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 936/1865] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:31 2022] DELETE /identity/v3/projects/fdc9d70df6f247718110dc1efd14d70a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:31.783143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de6fb-abdd-44eb-9e96-413c4f3c1439 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.784247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de6fb-abdd-44eb-9e96-413c4f3c1439 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.784560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1de6fb-abdd-44eb-9e96-413c4f3c1439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:31.826571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7f1de6fb-abdd-44eb-9e96-413c4f3c1439 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:31.826571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7f1de6fb-abdd-44eb-9e96-413c4f3c1439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.963861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:31.967323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:31.992298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 930/1866] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:31.993207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5362-384a-47b8-acd5-2640643ae999 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:31.996613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24439b5-4fee-4fcf-95e2-7f22bf9b093c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:31.997678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5362-384a-47b8-acd5-2640643ae999 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:31.998000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5362-384a-47b8-acd5-2640643ae999 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.000343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 931/1867] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:22:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:22:32.006449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.006766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.006975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.009522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.010233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.010473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.010745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] PATH_INFO: `/v3/projects/51bfad4d8abf43d7a41a4fb48b87faa1` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.018217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bfad4d8abf43d7a41a4fb48b87faa1)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.023056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.068755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:32.070970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.085909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 932/1868] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:32.091222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.108123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7b1a7-86db-4b16-88b1-43fb5968c9c9 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.117004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.118017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.118780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.119293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.120793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:32.121604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.128126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.151420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 933/1869] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:22:32.158302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.182784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96edba2-66f9-41ff-b0fb-8484456b3427 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.188132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bfad4d8abf43d7a41a4fb48b87faa1', 'request_id': 'req-f1e1f24c-828d-4100-86ef-b25b30dbaf61'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.200127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bfad4d8abf43d7a41a4fb48b87faa1', 'request_id': 'req-f1e1f24c-828d-4100-86ef-b25b30dbaf61'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.293208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bfad4d8abf43d7a41a4fb48b87faa1', 'request_id': 'req-f1e1f24c-828d-4100-86ef-b25b30dbaf61'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.306992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] The token cache is being invalidate because project 51bfad4d8abf43d7a41a4fb48b87faa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:32.307312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.308027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f1e1f24c-828d-4100-86ef-b25b30dbaf61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:32.311230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 937/1870] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:31 2022] DELETE /identity/v3/projects/51bfad4d8abf43d7a41a4fb48b87faa1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:32.312546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.312844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.313117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.332583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.336199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.336199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.336199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.338720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.342206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.342714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:32.345505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.460934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 938/1871] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:32.461865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.463600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.481754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639960b-f6ae-44ab-b329-a890b7dd884c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.489536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.490639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.491110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.491585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] PATH_INFO: `/v3/users/a0e1ba8a2bb6409da2f5c6bef09eab0a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.493654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e1ba8a2bb6409da2f5c6bef09eab0a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.497227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.516122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 934/1872] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/projects => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:32.516122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.519693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.639057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f964b7-7017-4456-b7dd-5f1e1dc225e6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.645856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.646765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.647085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.647317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.669334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.670127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.687846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 935/1873] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:32.688706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:32.690247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:32.777442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:32.794410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57d312-af33-46e8-bb58-f7381b32ad65 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:32.799432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:32.800059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:32.800390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:32.800664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:32.801301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:32.803295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:32.834114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e1ba8a2bb6409da2f5c6bef09eab0a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.002004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 936/1874] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:32 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:33.002004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.012217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f7ed8-98e5-43ab-93f7-85d6d2f84fb5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.019071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.020087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.020341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.020626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.021115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.022805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.037179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e1ba8a2bb6409da2f5c6bef09eab0a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.038322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e1ba8a2bb6409da2f5c6bef09eab0a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.039029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e1ba8a2bb6409da2f5c6bef09eab0a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.042340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 937/1875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:33.056638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.056981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca7350a4-1107-40b4-98f4-f31760ddf30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e1ba8a2bb6409da2f5c6bef09eab0a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:33.059372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:33.084236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2864e-ac71-4935-9cf5-bdffe21084b1 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.090635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.094130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.095839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.096307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.098131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.100789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.124209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 938/1876] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:33.127079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 939/1877] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:32 2022] DELETE /identity/v3/users/a0e1ba8a2bb6409da2f5c6bef09eab0a => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:33.132038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.145910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcff5b-825e-4277-a509-d38288557255 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.258612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.259450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.259734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.260011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] PATH_INFO: `/v3/projects/868c8cc14f81479cbe044ea9b50d9f8b/users/2c17edac13b4442cb3f74fa74c7ffe42/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.276558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868c8cc14f81479cbe044ea9b50d9f8b, user_id=2c17edac13b4442cb3f74fa74c7ffe42, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.283851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.399239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 939/1878] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:33 2022] PUT /identity/v3/projects/868c8cc14f81479cbe044ea9b50d9f8b/users/2c17edac13b4442cb3f74fa74c7ffe42/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:33.416494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.417848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.419911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.487362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] MFA Rules not processed for user `2c17edac13b4442cb3f74fa74c7ffe42`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:33.490443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:33.646783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 940/1879] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:33.661588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.663582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:33.838201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120bbc5-79c0-4462-b9ef-9403583a0664 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:33.842310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:33.843574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:33.843574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:33.844371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:33.856573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:33.858264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88f2af-f2be-4a5a-99f5-61b62958696f service glance] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:33.870288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 940/1880] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:33.935488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:33.937633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.108444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5893b-39fb-43df-a037-141c3153e192 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.114304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.114995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.115289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.115596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] PATH_INFO: `/v3/projects/3edfa6791f104e32a31c78ab1534062a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.116866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edfa6791f104e32a31c78ab1534062a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.119333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.123817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:34.301614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edfa6791f104e32a31c78ab1534062a', 'request_id': 'req-d5909089-3d46-4293-98aa-695faad59044'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.326624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edfa6791f104e32a31c78ab1534062a', 'request_id': 'req-d5909089-3d46-4293-98aa-695faad59044'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.461036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edfa6791f104e32a31c78ab1534062a', 'request_id': 'req-d5909089-3d46-4293-98aa-695faad59044'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.483523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] The token cache is being invalidate because project 3edfa6791f104e32a31c78ab1534062a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:34.485384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.486235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d5909089-3d46-4293-98aa-695faad59044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:34.489801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 941/1881] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:33 2022] DELETE /identity/v3/projects/3edfa6791f104e32a31c78ab1534062a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:34.498578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.498578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.498578 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.529202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:34.530440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.635559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 941/1882] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:34.644663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.644955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.645240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.668607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:34.669858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:34.679178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 942/1883] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:34.684100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.700753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfcdc6-05b5-40a4-afa5-646cffeecc8f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.708284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.709317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.709796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.710328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.711514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:34.712068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.714709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.734788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 942/1884] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:34.739336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.748932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44949f2-4a30-4253-bb0e-8b8c542d1241 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:34.754815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:34.755649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:34.756122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:34.756499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:34.757213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:34.759391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:34.960012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 943/1885] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:34 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:34.964150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:34.986893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254efca1-ea26-469e-8071-d5a58b3be087 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.088335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.089451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.094438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.094438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.094438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.096326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:35.244125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 943/1886] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:34 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:35.248947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.268840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd9857-d827-4183-b048-b2c306fa964f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.279845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.282056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.282493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.283480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.284297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.285973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:35.298512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 944/1887] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:35.302882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.314372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d8d6-fba5-4342-b2fe-a514a073aae6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.319600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.320295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.320529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.320891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.322047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.323135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0039ae-9a18-476b-be69-4266c9152973 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:35.336570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 944/1888] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:35.348047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.361170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453bcca-4bf8-4237-905a-98ef6225955d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.372566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.372566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.372566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.372566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] PATH_INFO: `/v3/projects/009372e90d114f1899a69394d3d2fdd5/users/721e0ab40c2e40cf94dc7d13c4bd02f6/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.391729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=009372e90d114f1899a69394d3d2fdd5, user_id=721e0ab40c2e40cf94dc7d13c4bd02f6, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.395793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:35.551531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 945/1889] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:35 2022] PUT /identity/v3/projects/009372e90d114f1899a69394d3d2fdd5/users/721e0ab40c2e40cf94dc7d13c4bd02f6/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:35.564494 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.564787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.565064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.601928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] MFA Rules not processed for user `721e0ab40c2e40cf94dc7d13c4bd02f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:35.603417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:35.717457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 945/1890] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:35.717598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:35.766853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:35.873753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aceaf-bf95-44a3-9f9d-d81d08d7dcfd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:35.880644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:35.881546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:35.881922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:35.882261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:35.882911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:35.885157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.020228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 946/1891] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:36.024439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.041630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b939577-4f5f-412f-bf04-c6359fa5b7e6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.114793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.115569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.115826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.116106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.116744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.118800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.253005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 946/1892] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:36.254008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.278348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ddbb-336a-45e3-85e3-e2121a33c5e2 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.303218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.305445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.305818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.306115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.307723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.309587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.363271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.363515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 947/1893] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:36.390772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd11f7-a0c4-4aaa-aafb-287dfbf8f529 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.413548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.414751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.416888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.417678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] PATH_INFO: `/v3/projects/25049a8792dc463ba3450601a7b805cd/users/9c8bfe7131084ca2bc0b213a822538e9/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.461067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25049a8792dc463ba3450601a7b805cd, user_id=9c8bfe7131084ca2bc0b213a822538e9, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.466174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.570637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 947/1894] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:36 2022] PUT /identity/v3/projects/25049a8792dc463ba3450601a7b805cd/users/9c8bfe7131084ca2bc0b213a822538e9/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:36.577844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.593759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0351-a305-40e6-aece-c9be9fa8174e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.694256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.698609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.698609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.698609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.698609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.698609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08593c-f436-439c-b2d0-d93a0341c867 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.710855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 948/1895] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:36.716010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:36.744577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b256a3-994f-4bec-8deb-eb745e399a4b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:36.751108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:36.752338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.753114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.753459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] PATH_INFO: `/v3/projects/25049a8792dc463ba3450601a7b805cd/users/9c8bfe7131084ca2bc0b213a822538e9/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.755703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25049a8792dc463ba3450601a7b805cd, user_id=9c8bfe7131084ca2bc0b213a822538e9, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:36.758711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:36.771943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 948/1896] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:36 2022] PUT /identity/v3/projects/25049a8792dc463ba3450601a7b805cd/users/9c8bfe7131084ca2bc0b213a822538e9/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:36.783296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:36.783598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:36.783870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:36.821122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] MFA Rules not processed for user `9c8bfe7131084ca2bc0b213a822538e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:36.822430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.073030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 949/1897] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:37.292377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.295072 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.421539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6e4d3-cd6a-49d3-b4b9-81797e8b1d9d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.451830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.452560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.452843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.453115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.491645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.493208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.507097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 949/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:37.750443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.752582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.836617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:37.838490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:37.858652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4044ea3-50d5-4f50-92b2-e14f3766b60d service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.867088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.868133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.868655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.870328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.902183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad82c72-8e02-4ba9-af2c-cca700d0549f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:37.914396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:37.916998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:37.917592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:37.918210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] PATH_INFO: `/v3/users/76b28221135c423d96a4d659c142411c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:37.925291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b28221135c423d96a4d659c142411c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.935310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:37.988846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:37.991151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc58fe-020c-4282-b331-5de6ca5fa3e7 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.022954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 950/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:38.274507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b28221135c423d96a4d659c142411c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.398333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b28221135c423d96a4d659c142411c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.399363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b28221135c423d96a4d659c142411c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.400239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b28221135c423d96a4d659c142411c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.411441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b28221135c423d96a4d659c142411c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:38.447660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 950/1900] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:37 2022] DELETE /identity/v3/users/76b28221135c423d96a4d659c142411c => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:38.449333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.449977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.449977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.471977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:38.473316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.543793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:38.601331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 951/1901] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:38.624678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.626431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.673453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:38.777649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17b782-7604-4ebe-8a98-eb86752a4cc1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.805429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.806207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:38.808693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:38.815601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.817708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.818218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.835834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.837625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfa615-592e-4f62-88d9-7b47604860fa None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:38.838710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286db08-df8c-42f7-a1f6-e22130712914 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.848014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:38.857502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:38.861967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:38.862577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] PATH_INFO: `/v3/users/721e0ab40c2e40cf94dc7d13c4bd02f6` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:38.864914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=721e0ab40c2e40cf94dc7d13c4bd02f6)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:38.868246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:38.880662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 951/1902] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:22:39.207358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721e0ab40c2e40cf94dc7d13c4bd02f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.364341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721e0ab40c2e40cf94dc7d13c4bd02f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.365323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721e0ab40c2e40cf94dc7d13c4bd02f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.366249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721e0ab40c2e40cf94dc7d13c4bd02f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.379823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721e0ab40c2e40cf94dc7d13c4bd02f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.405236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 952/1903] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:38 2022] DELETE /identity/v3/users/721e0ab40c2e40cf94dc7d13c4bd02f6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:39.416917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.417962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.418896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.451124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:39.452496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.539099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 952/1904] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:39.553673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.555230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.632025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:39.634263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:39.640395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3efa78-606d-4adc-af63-23d24513d12c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.649310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.651922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.652212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.652600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.655992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e201-8d2e-43c8-b0cd-4dcbd4bd29d1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:39.664582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:39.667043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:39.667548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:39.667668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.668051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] PATH_INFO: `/v3/projects/c0c073d9324849878142c439e3e7405b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:39.669456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.670697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c073d9324849878142c439e3e7405b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:39.675149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:39.684623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 953/1905] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:39.865153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c073d9324849878142c439e3e7405b', 'request_id': 'req-e60dde5d-687e-42b7-8e48-9d37eb3197cb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.874392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c073d9324849878142c439e3e7405b', 'request_id': 'req-e60dde5d-687e-42b7-8e48-9d37eb3197cb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.981595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c073d9324849878142c439e3e7405b', 'request_id': 'req-e60dde5d-687e-42b7-8e48-9d37eb3197cb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.987094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:39.998182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] The token cache is being invalidate because project c0c073d9324849878142c439e3e7405b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:39.998595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:39.999311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.000918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 953/1906] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:39 2022] DELETE /identity/v3/projects/c0c073d9324849878142c439e3e7405b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:40.007115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.020689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332402d4-2ca6-4053-8ba9-13948b331ec2 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.106238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.107013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.107352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.107692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] PATH_INFO: `/v3/users/51cc70b08ea34b1db9f15bfa07bd4d3f` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.108951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cc70b08ea34b1db9f15bfa07bd4d3f)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.111603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.339845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.339845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:40.361417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dde5d-687e-42b7-8e48-9d37eb3197cb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.369203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cc70b08ea34b1db9f15bfa07bd4d3f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.371996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.377102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.377102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.377102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] PATH_INFO: `/v3/projects/009372e90d114f1899a69394d3d2fdd5` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.378054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=009372e90d114f1899a69394d3d2fdd5)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.381844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:40.468453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cc70b08ea34b1db9f15bfa07bd4d3f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.469610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cc70b08ea34b1db9f15bfa07bd4d3f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.472626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cc70b08ea34b1db9f15bfa07bd4d3f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.491748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cc70b08ea34b1db9f15bfa07bd4d3f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.547189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 954/1907] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:40 2022] DELETE /identity/v3/users/51cc70b08ea34b1db9f15bfa07bd4d3f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:40.576179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009372e90d114f1899a69394d3d2fdd5', 'request_id': 'req-9ffb43f9-8196-46b3-be11-8cc409d81525'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.590382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009372e90d114f1899a69394d3d2fdd5', 'request_id': 'req-9ffb43f9-8196-46b3-be11-8cc409d81525'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.708096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009372e90d114f1899a69394d3d2fdd5', 'request_id': 'req-9ffb43f9-8196-46b3-be11-8cc409d81525'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.722186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] The token cache is being invalidate because project 009372e90d114f1899a69394d3d2fdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:40.722679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.723500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:40.725911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 954/1908] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:40 2022] DELETE /identity/v3/projects/009372e90d114f1899a69394d3d2fdd5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:40.729662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:40.731751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:40.811746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58092ee6-c807-43a5-b477-5df2f8e562e6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:40.880547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:40.881283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:40.881631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:40.882006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] PATH_INFO: `/v3/users/9c8bfe7131084ca2bc0b213a822538e9` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:40.883273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8bfe7131084ca2bc0b213a822538e9)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:40.885346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.212971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.215492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.234003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8bfe7131084ca2bc0b213a822538e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.246616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb43f9-8196-46b3-be11-8cc409d81525 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.256040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.258029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.262820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.262820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] PATH_INFO: `/v3/projects/9165996e515542d1b1f4ea5dc2b943bb` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.262820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9165996e515542d1b1f4ea5dc2b943bb)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.262820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.325372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8bfe7131084ca2bc0b213a822538e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.326486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8bfe7131084ca2bc0b213a822538e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.327517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8bfe7131084ca2bc0b213a822538e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.342872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-feefac5e-0ec4-482d-a6c4-7f7e5bc51b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8bfe7131084ca2bc0b213a822538e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.373190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 955/1909] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:40 2022] DELETE /identity/v3/users/9c8bfe7131084ca2bc0b213a822538e9 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:41.430624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9165996e515542d1b1f4ea5dc2b943bb', 'request_id': 'req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.439186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9165996e515542d1b1f4ea5dc2b943bb', 'request_id': 'req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.536128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9165996e515542d1b1f4ea5dc2b943bb', 'request_id': 'req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.550660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] The token cache is being invalidate because project 9165996e515542d1b1f4ea5dc2b943bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:41.551396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.551802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-cfbdcd40-5e5a-4b48-97a3-33ac0328920b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:41.553455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 955/1910] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:41 2022] DELETE /identity/v3/projects/9165996e515542d1b1f4ea5dc2b943bb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:41.558632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.559185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.559764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.587016 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:41.588469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.688423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 956/1911] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:41.697472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.697757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.698083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.722449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:41.736387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:41.736387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 956/1912] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:41.739018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.755015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cdcb7-75f2-4b93-a26e-46a748a681b0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.760724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.761361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.761646 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.761953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.762777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:41.763124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.765585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:41.782562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 957/1913] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:41.792309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:41.809930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f482a3d-4a9b-4aee-8453-1920699a499a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:41.833332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:41.847339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:41.847339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:41.847339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:41.847339 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:41.851104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.105568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 957/1914] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:41 2022] POST /identity/v3/projects => generated 371 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:42.109686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.123173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6045d0-82de-4573-92e5-c9dde547106f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.193132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:42.212518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.213409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.213851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.214155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.214827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.216852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.278946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.299018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.320832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78e54-9f7a-4ff4-9754-9daf93df0c4e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.325461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 958/1915] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:42 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:42.328083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.329231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.330695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.330976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.331517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] PATH_INFO: `/v3/projects/25049a8792dc463ba3450601a7b805cd` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.332742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25049a8792dc463ba3450601a7b805cd)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.334898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.341226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818a1ee-0123-470f-a950-566bced3a8ed admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.350575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.350940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.351397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.351672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.352387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.354500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.367261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 959/1916] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:42.373777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.387255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba223be-173b-4a0c-adf0-7a520eb31860 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.395831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.396629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.396951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.397322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.398103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.401548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.431178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 960/1917] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:42.435125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.450300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf8e2e-7c1a-49a5-b642-f5579b1ea335 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.454483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.457384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.457384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.457384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] PATH_INFO: `/v3/projects/ee0d5c8cd6524c50a7c04d90362a5cd7/users/c54e848a26a84f9a9ad953deeffc5c09/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.478033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0d5c8cd6524c50a7c04d90362a5cd7, user_id=c54e848a26a84f9a9ad953deeffc5c09, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.483922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5d39-cb36-4aad-9e85-70b89807164c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.629177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 961/1918] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:42 2022] PUT /identity/v3/projects/ee0d5c8cd6524c50a7c04d90362a5cd7/users/c54e848a26a84f9a9ad953deeffc5c09/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:42.635409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.635409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.635409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.651992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25049a8792dc463ba3450601a7b805cd', 'request_id': 'req-8872f35b-e812-4977-ac61-40d14d01567a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.659677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25049a8792dc463ba3450601a7b805cd', 'request_id': 'req-8872f35b-e812-4977-ac61-40d14d01567a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.684602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:42.689292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.779761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 962/1919] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:42.785533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25049a8792dc463ba3450601a7b805cd', 'request_id': 'req-8872f35b-e812-4977-ac61-40d14d01567a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.795021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.796624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.800019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] The token cache is being invalidate because project 25049a8792dc463ba3450601a7b805cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:42.800572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.801799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8872f35b-e812-4977-ac61-40d14d01567a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:42.806274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 958/1920] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:42 2022] DELETE /identity/v3/projects/25049a8792dc463ba3450601a7b805cd => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:42.809741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950267-6b9b-4979-bb22-316ac0599432 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.810267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950267-6b9b-4979-bb22-316ac0599432 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.810706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950267-6b9b-4979-bb22-316ac0599432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.834367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1e950267-6b9b-4979-bb22-316ac0599432 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:42.835862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1e950267-6b9b-4979-bb22-316ac0599432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.847589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 959/1921] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:42.861070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.871928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.872367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.884723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ad82d-864b-42be-81ae-c345babce1bf None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.892935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.894067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.894737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.895197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.898212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.907410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:42.910214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:42.919391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.922212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:42.927146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 960/1922] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:42.933536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:42.950203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b34e4-c392-475a-8d46-ce04f9369d2e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:42.954116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 963/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:42.966650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:42.967297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:42.967577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:42.967902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:42.968573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:42.968938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:42.970752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.027048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 961/1924] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:43.028451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.041842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f7ef0-d023-4294-89cb-938fa946009a service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.051176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.051957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.052305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.052704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.055864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.056371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.188497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 964/1925] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:43 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:43.190748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.202392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4925860-4067-42f0-ac45-85155771fc61 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.298253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.300042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.301027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.301813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.303187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.306958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.467103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 962/1926] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:43 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:43.479883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.492753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2881df-ed06-4951-91e5-43c681295f36 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.497866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.498606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.498955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.499296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.500054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.501743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.516932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 965/1927] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:43.523613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.537962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feba1d4-1371-441c-b2d3-30c77089be8b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.552325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.562990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.562990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.562990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.562990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.562990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856e03-2be1-485a-a9ba-e4708a6152d7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.571104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 963/1928] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:43.575326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.592693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39520551-bbb2-4733-a763-2e8ac0f23c49 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:43.602159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:43.604026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.604880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.605493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] PATH_INFO: `/v3/projects/1a16bc46d96a409cb8a3ae03a6f61905/users/a1c60b00a3cb4c09974d1954cce11994/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.627882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a16bc46d96a409cb8a3ae03a6f61905, user_id=a1c60b00a3cb4c09974d1954cce11994, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:43.630667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:43.754504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 966/1929] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:43 2022] PUT /identity/v3/projects/1a16bc46d96a409cb8a3ae03a6f61905/users/a1c60b00a3cb4c09974d1954cce11994/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:43.765959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf96c-4a2b-4d60-a2c2-168595d4909e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:43.766329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf96c-4a2b-4d60-a2c2-168595d4909e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:43.766610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcf96c-4a2b-4d60-a2c2-168595d4909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:43.836473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e6dcf96c-4a2b-4d60-a2c2-168595d4909e None None] MFA Rules not processed for user `a1c60b00a3cb4c09974d1954cce11994`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:43.838319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e6dcf96c-4a2b-4d60-a2c2-168595d4909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:43.957688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:43.971006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 964/1930] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:43.985793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:43.989135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:44.097591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c42831-25f8-4a9c-a4aa-6bd40d5a1db8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:44.105961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:44.106990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:44.108178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:44.108702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:44.122869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:44.125408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:44.166386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 967/1931] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:44.973751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:45.480815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.481246 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.481320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.562067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] MFA Rules not processed for user `c54e848a26a84f9a9ad953deeffc5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:45.564886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:45.716150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 965/1932] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:45.722585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:45.724918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:45.842871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374ab57-af40-4ab6-b720-1cdc4447c968 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:45.854212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:45.855033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:45.855321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:45.855642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:45.856299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:45.858344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.005686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 968/1933] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:45 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:46.011128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.025731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92c2f-becd-435c-ae8a-41c16b5c7df2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.165436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:46.185755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.186828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.186999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.187379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.188181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.191340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.309733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 966/1934] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:46 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:46.311859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.326185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68b451-be77-4a01-8551-e4a16847af6d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.332027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.332736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.333110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.333541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.334766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.336903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.355375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 969/1935] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:46.360343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.374238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118b30f-7188-43c6-9d17-745620bd2265 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.382544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.383896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.384519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.385016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] PATH_INFO: `/v3/projects/273bde5e80ef458ba118fadb5705f384/users/0057378076c043e99df43bc55d4b45e3/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.413041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=273bde5e80ef458ba118fadb5705f384, user_id=0057378076c043e99df43bc55d4b45e3, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.416836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.520561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 967/1936] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:46 2022] PUT /identity/v3/projects/273bde5e80ef458ba118fadb5705f384/users/0057378076c043e99df43bc55d4b45e3/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:46.525594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.544039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72686-558e-411f-ab59-a886b9807602 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.747820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.749722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.750219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.750781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.751733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.753539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255682af-a4fa-45ee-b14c-95b808e8b308 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.771292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 970/1937] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:46.776864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:46.798162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21051ef-880f-44f6-a742-98b1d862c0cb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:46.804677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:46.806232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:46.806611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:46.806997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] PATH_INFO: `/v3/projects/273bde5e80ef458ba118fadb5705f384/users/0057378076c043e99df43bc55d4b45e3/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:46.809808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273bde5e80ef458ba118fadb5705f384, user_id=0057378076c043e99df43bc55d4b45e3, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:46.815685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721297-400e-4936-8ced-f56fefef3b07 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:46.833590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 968/1938] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:46 2022] PUT /identity/v3/projects/273bde5e80ef458ba118fadb5705f384/users/0057378076c043e99df43bc55d4b45e3/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:47.092780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:48.761413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:49.826605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:50.097679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.099150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.099860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.161583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] MFA Rules not processed for user `0057378076c043e99df43bc55d4b45e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:50.165792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.326598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 971/1939] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:50.338410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.344065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.344065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.364587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] MFA Rules not processed for user `c54e848a26a84f9a9ad953deeffc5c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:50.367041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.494407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 969/1940] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:50.507519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:50.509197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:50.587428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:50.697672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2b3b-5554-4845-925d-46ed08523278 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:50.717115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:50.717769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:50.718249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:50.718553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:50.728691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:50.730471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09a2bc-0c6b-40dc-8c94-d239cf822a97 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:50.742049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 972/1941] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:52.403882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:52.405318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:52.481955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f595ee1-f513-4e13-8733-0501c9f7d03e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:52.487623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:52.488605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.489557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.489988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] PATH_INFO: `/v3/users/6fe39e82aec24b83823e4b10f89cce37` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:52.491639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe39e82aec24b83823e4b10f89cce37)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:52.494080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:52.795721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe39e82aec24b83823e4b10f89cce37'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.935236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe39e82aec24b83823e4b10f89cce37'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.935626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe39e82aec24b83823e4b10f89cce37'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.936490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe39e82aec24b83823e4b10f89cce37'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.949780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe39e82aec24b83823e4b10f89cce37'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:52.981663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 970/1942] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:52 2022] DELETE /identity/v3/users/6fe39e82aec24b83823e4b10f89cce37 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:52.984530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:52.985308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:52.985759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.030568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:53.032950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.122349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 973/1943] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:53.136473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:53.138290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:53.217912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c794c-8660-41c6-93d5-e55484de46cd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:53.225345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:53.226479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:53.226974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:53.227463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:53.244384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:53.247262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:53.260034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 971/1944] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:53.312070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:54.222828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.225970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:54.243025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38a52f-2620-45b8-bf97-3210379311d6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.250426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.251533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.251998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.252343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] PATH_INFO: `/v3/projects/957116017f344fd5b34acec4ae4acc0a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.254227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957116017f344fd5b34acec4ae4acc0a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.258132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:54.438401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957116017f344fd5b34acec4ae4acc0a', 'request_id': 'req-460e5d8f-d55c-4a59-a70a-1397adcf5e88'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.447761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957116017f344fd5b34acec4ae4acc0a', 'request_id': 'req-460e5d8f-d55c-4a59-a70a-1397adcf5e88'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.626246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957116017f344fd5b34acec4ae4acc0a', 'request_id': 'req-460e5d8f-d55c-4a59-a70a-1397adcf5e88'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.651230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] The token cache is being invalidate because project 957116017f344fd5b34acec4ae4acc0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:54.651797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.653101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:54.659081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 974/1945] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:54 2022] DELETE /identity/v3/projects/957116017f344fd5b34acec4ae4acc0a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:54.661184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:54.664185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:54.679960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fe919-0db3-451f-8b4c-c9e0cdc4ea71 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:54.781717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:54.782593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:54.783081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:54.783505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] PATH_INFO: `/v3/users/41c624a0550448f0a62a361b7074da2b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:54.784943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c624a0550448f0a62a361b7074da2b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:54.787115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:55.029806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c624a0550448f0a62a361b7074da2b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.145785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c624a0550448f0a62a361b7074da2b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.147821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c624a0550448f0a62a361b7074da2b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.148837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c624a0550448f0a62a361b7074da2b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.163255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb6b2bc6-7790-44e8-89f7-885009a7c627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c624a0550448f0a62a361b7074da2b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:55.194852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 972/1946] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:22:54 2022] DELETE /identity/v3/users/41c624a0550448f0a62a361b7074da2b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:55.906200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:55.908868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:55.934230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5d8f-d55c-4a59-a70a-1397adcf5e88 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.037705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.038457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.038738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.039514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] PATH_INFO: `/v3/projects/e9f70e7bd6da47a5a99e992afd826111` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.041149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f70e7bd6da47a5a99e992afd826111)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.043175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.241707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f70e7bd6da47a5a99e992afd826111', 'request_id': 'req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.250593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f70e7bd6da47a5a99e992afd826111', 'request_id': 'req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.381088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f70e7bd6da47a5a99e992afd826111', 'request_id': 'req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.386780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:56.401289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] The token cache is being invalidate because project e9f70e7bd6da47a5a99e992afd826111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:22:56.401749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.402353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6fb0d907-fca7-4c0a-a6fe-5d40b17a7e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:22:56.403953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 975/1947] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:22:55 2022] DELETE /identity/v3/projects/e9f70e7bd6da47a5a99e992afd826111 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:56.411849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.412602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.412838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.451816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:56.454293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.570794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 973/1948] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:56.587453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.587716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.587986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.621618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:56.628767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:56.640377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 976/1949] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:22:56.648567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.664916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:56.672305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44cc8-f6c2-4732-9408-789f4aad2c7b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.681955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.682604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.682883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.683166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.683880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:22:56.684188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.685905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.702260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 974/1950] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:22:56.710278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.728281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba909-1890-4329-98ff-1b6dc6678ef1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:56.737415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:56.738798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:56.743375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:56.743375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:56.743375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:56.748764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:56.944411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 977/1951] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:56.948826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:56.961453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd874e-44dc-4e95-8d02-c6b20eaea8b3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.060218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.060218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.060218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.060218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.061110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.063205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.148581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 975/1952] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:56 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:57.155864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.178932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d95ca-0975-4cc9-be71-35a486d3a927 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.182121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.182929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.183418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.183887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.184802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.186729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.200956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 978/1953] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:57.206777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.227566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f56b07-9052-4109-b87b-76659fc89048 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.238730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.239718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.241028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.241512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.242668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.245316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6b06c-2936-43ad-9fc0-c6e378d301f2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.270042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 976/1954] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:22:57.271386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.309624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56d48f-1b05-4d26-9955-686a9d4765b3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.321352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.322401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.322897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.323351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] PATH_INFO: `/v3/projects/815f4922c38a47349f6b3bc865a1793a/users/a7633eb27d6c46508d04a06a5062b74a/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.351523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815f4922c38a47349f6b3bc865a1793a, user_id=a7633eb27d6c46508d04a06a5062b74a, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.357318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:57.465699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 979/1955] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:57 2022] PUT /identity/v3/projects/815f4922c38a47349f6b3bc865a1793a/users/a7633eb27d6c46508d04a06a5062b74a/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:57.485431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.486394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.487522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.547283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] MFA Rules not processed for user `a7633eb27d6c46508d04a06a5062b74a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:57.549747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:57.645066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 977/1956] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:57.656269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:57.758579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efc971-b980-4b05-8454-a663c2e47113 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:57.764448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:57.765097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:57.765379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:57.765651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:57.766338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:57.768692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.048423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 980/1957] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:22:57 2022] POST /identity/v3/projects => generated 379 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:22:58.052384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.064630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a8e97-4e95-4895-81bb-fbdc2378cd33 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.165953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.167237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.167963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.168385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.169805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.175029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.357042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 978/1958] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:22:58.357814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.375598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b3b1-3c96-4c89-864c-3ac4d8fb2e35 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.385034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.385553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.385961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.386416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.387230 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.389142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.408549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 981/1959] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.409391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.424604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0d34d-41fa-4266-a4a3-a0d9e9ffa07f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.435034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.436351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.436806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.437219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] PATH_INFO: `/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41/users/7410602f217541fbb5efb04a36fbf549/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.477622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74913a1cafb4a97ab297c2a20eb8b41, user_id=7410602f217541fbb5efb04a36fbf549, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.482486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.589385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:58.602773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 979/1960] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41/users/7410602f217541fbb5efb04a36fbf549/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:22:58.607283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.630692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117610b-38bc-4843-884c-18622d9e165d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.771488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.773329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.774604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.775240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.776555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.779668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509c02d-0deb-4936-a522-6291cf2b80a1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.800894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 982/1961] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:22:58.806017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:58.823635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7cb-80e4-4385-b816-3ba89c8bde06 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:58.836321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:58.837927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.838248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.838832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] PATH_INFO: `/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41/users/7410602f217541fbb5efb04a36fbf549/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.843257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74913a1cafb4a97ab297c2a20eb8b41, user_id=7410602f217541fbb5efb04a36fbf549, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:58.849980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:58.884003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 980/1962] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:22:58 2022] PUT /identity/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41/users/7410602f217541fbb5efb04a36fbf549/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:22:58.896065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:58.897267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:58.897576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:58.947741 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] MFA Rules not processed for user `7410602f217541fbb5efb04a36fbf549`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:22:58.949237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.039949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 983/1963] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:22:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:22:59.264868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.266664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.349027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f7f60-b127-478d-82e3-812bc9c5a385 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.349027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.349027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.349027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.349685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:22:59.354559 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:22:59.356435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:22:59.368947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 981/1964] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:22:59.913842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:22:59.917215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:22:59.946189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e7686-9647-413f-aec8-a96d79400c6f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:22:59.956156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:22:59.957380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:22:59.958065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:22:59.959639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:00.034239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:00.069617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:00.071044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:00.085894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 984/1965] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:22:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:00.696171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:02.314912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:02.724885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:05.582454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:06.526911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:09.544054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:09.545805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:09.649020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c03cce-5e34-4220-9c6a-1ccbad0d181b service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:09.655009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:09.655923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:09.656520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:09.656945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] PATH_INFO: `/v3/users/f429ea829f45484587a09157e1793650` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:09.658455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f429ea829f45484587a09157e1793650)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:09.661319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:10.046016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f429ea829f45484587a09157e1793650'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:10.207095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f429ea829f45484587a09157e1793650'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:10.207983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f429ea829f45484587a09157e1793650'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:10.208979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f429ea829f45484587a09157e1793650'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:10.222446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-68a02def-0c7b-455a-8caa-2c4816204d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f429ea829f45484587a09157e1793650'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:10.253207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 982/1966] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:09 2022] DELETE /identity/v3/users/f429ea829f45484587a09157e1793650 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:10.596590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:10.610036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3edaee-d4e5-4780-9677-8b6db6064f2f service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:10.613141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:10.743009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:10.743729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:10.744014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:10.744289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] PATH_INFO: `/v3/projects/b2228eabebfa4bab9fa6cbef7276117e` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:10.747974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2228eabebfa4bab9fa6cbef7276117e)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:10.754405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.031909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2228eabebfa4bab9fa6cbef7276117e', 'request_id': 'req-f1c48f19-c45a-4378-8011-8efb44cd8a61'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:11.038606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2228eabebfa4bab9fa6cbef7276117e', 'request_id': 'req-f1c48f19-c45a-4378-8011-8efb44cd8a61'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:11.214539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2228eabebfa4bab9fa6cbef7276117e', 'request_id': 'req-f1c48f19-c45a-4378-8011-8efb44cd8a61'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:11.229053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] The token cache is being invalidate because project b2228eabebfa4bab9fa6cbef7276117e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:11.229330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:11.230071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f1c48f19-c45a-4378-8011-8efb44cd8a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:11.232019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 985/1967] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:10 2022] DELETE /identity/v3/projects/b2228eabebfa4bab9fa6cbef7276117e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:11.237102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.237382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.237650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.266284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:11.267644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:11.346392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 983/1968] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:11.359101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.359415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.359651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.386260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:11.387963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:11.398875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 986/1969] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:11.404354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.420002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61165-c789-4ca8-8bf2-9ebb22974881 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.426175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.426817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.427343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.427625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.428349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:11.429293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.431889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.451152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 984/1970] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:23:11.454287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.464914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ead4a-2a5d-4efa-974d-f1600a530e74 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.474150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.474150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.474150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.474150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.474724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.474724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.631784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 987/1971] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:11 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:11.637273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.648962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24bcf67-6816-4862-a963-8dce260c31f1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.682593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:11.719059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.719749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.720418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.720418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.720933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.723241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.872573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 985/1972] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:11 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:11.877481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.891179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de0046-79a1-4ce5-902c-2e82aa48cf40 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.899683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.901688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.903530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.903530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.904216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.908028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.923372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 988/1973] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:11.929141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.945295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6e4ed-12dc-4d7a-bc79-a830c804b819 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:11.951924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:11.952802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:11.953255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:11.953670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:11.954514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:11.956999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4f182-380c-437a-844d-5eb6751f2a7f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:11.971693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 986/1974] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:11.976964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:11.994412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c5a9d-46bf-4663-ad69-a3deecb98dd1 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:12.003251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:12.004545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.005242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.005678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] PATH_INFO: `/v3/projects/c33dfb0f1ddd4ed6ae4b8baeafea619b/users/bbb975a644ea4e9b9582b8e4b06357b1/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.034945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33dfb0f1ddd4ed6ae4b8baeafea619b, user_id=bbb975a644ea4e9b9582b8e4b06357b1, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:12.038670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:12.162320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 989/1975] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:11 2022] PUT /identity/v3/projects/c33dfb0f1ddd4ed6ae4b8baeafea619b/users/bbb975a644ea4e9b9582b8e4b06357b1/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:12.171228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.171862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.172433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.196261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:12.197702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.200633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:12.204032 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.294418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 987/1976] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:12.308643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:12.311545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.332516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b8ddc-6eca-44f8-8110-f6ca46c889b8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:12.345111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:12.346020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.346438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.346814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] PATH_INFO: `/v3/users/2c17edac13b4442cb3f74fa74c7ffe42` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.348573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c17edac13b4442cb3f74fa74c7ffe42)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:12.351339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:12.393392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b12056-21bf-4031-ab79-3d6efe1588b0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:12.400949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:12.402063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.402561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.403050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.421806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:12.424956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298a0d-f9d7-432e-997d-e95a95392568 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:12.444814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 988/1977] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:12.677222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c17edac13b4442cb3f74fa74c7ffe42'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:12.801509 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c17edac13b4442cb3f74fa74c7ffe42'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:12.802760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c17edac13b4442cb3f74fa74c7ffe42'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:12.804812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c17edac13b4442cb3f74fa74c7ffe42'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:12.817143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c17edac13b4442cb3f74fa74c7ffe42'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:12.851440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 990/1978] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:12 2022] DELETE /identity/v3/users/2c17edac13b4442cb3f74fa74c7ffe42 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:12.858873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:12.859912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:12.860346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:12.888192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:12.890608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:12.996112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 989/1979] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:13.020165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.024814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:13.137183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599a4a-f9e1-425b-960f-55dd13781b8c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:13.141928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:13.142691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:13.143031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:13.143365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:13.154792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:13.156271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5f64-fe6a-4cba-a829-1f90898111ec service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:13.172108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 991/1980] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:13.802584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:13.806076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:13.863455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83940c37-7119-41eb-9cfc-c5c876a95a69 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:13.869265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:13.870002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:13.870290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:13.870713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] PATH_INFO: `/v3/projects/868c8cc14f81479cbe044ea9b50d9f8b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:13.872034 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868c8cc14f81479cbe044ea9b50d9f8b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:13.874131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.037740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868c8cc14f81479cbe044ea9b50d9f8b', 'request_id': 'req-792bc395-e989-4896-a987-c6f5c41fe184'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:14.048528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868c8cc14f81479cbe044ea9b50d9f8b', 'request_id': 'req-792bc395-e989-4896-a987-c6f5c41fe184'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:14.236019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868c8cc14f81479cbe044ea9b50d9f8b', 'request_id': 'req-792bc395-e989-4896-a987-c6f5c41fe184'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:14.252011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] The token cache is being invalidate because project 868c8cc14f81479cbe044ea9b50d9f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:14.252989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:14.253735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-792bc395-e989-4896-a987-c6f5c41fe184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:14.256403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 990/1981] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:13 2022] DELETE /identity/v3/projects/868c8cc14f81479cbe044ea9b50d9f8b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:14.265337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.267131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.268249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.277455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:14.317335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:14.319671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:14.407022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 992/1982] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:14.415417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.415754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.417101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.439573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:14.440957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:14.449584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 991/1983] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:14.454036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:14.465328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e6f42-5147-4494-a47c-c58d9c7b5563 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:14.470457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:14.471124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.471472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.471773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.472462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:14.472765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:14.474491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.489690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 993/1984] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:14.495187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:14.508953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7c30-9e0f-4bda-a85d-32ef7057e10a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:14.517188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:14.518110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.518513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.518906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.519668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:14.522301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.686513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 992/1985] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:14 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:14.688594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:14.712120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e03630-7684-47ca-94fa-19a4a70d70f1 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:14.810979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:14.812053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:14.812330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:14.812765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:14.813661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:14.816074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:14.978025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 994/1986] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:14 2022] POST /identity/v3/users => generated 287 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:14.978330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:14.998195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91f0c-985d-46c3-a00c-3a984cae5934 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.005020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.006359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.006921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.007387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.008342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.011621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.027997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 993/1987] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:15.033857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:15.047868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43e542-cbd0-4efb-ab7e-bb98f43950f4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.053679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.054362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.054643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.054915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.055764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.058902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120a9c7-a35d-4b17-ad85-b301a97b57b7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.076848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 995/1988] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:15.081985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:15.105222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec379b58-521c-431a-b5a4-b97a979c5bf7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.115051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.119271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.119271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.119271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] PATH_INFO: `/v3/projects/f90cf866a8fb4d959f391ac98b42dda4/users/2a71db6cea734be0b88d03ebeb7bc144/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.150217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90cf866a8fb4d959f391ac98b42dda4, user_id=2a71db6cea734be0b88d03ebeb7bc144, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.158348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.270528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 994/1989] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:15 2022] PUT /identity/v3/projects/f90cf866a8fb4d959f391ac98b42dda4/users/2a71db6cea734be0b88d03ebeb7bc144/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:15.278330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.279391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.279391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.312656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:15.315718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:15.392921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:15.422808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:15.426192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:15.498885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 996/1990] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:15.524318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:15.526695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:15.650142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e7a4f5-98b2-44aa-a724-fcb0e19411f9 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.660561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.662333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.663064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.663767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] PATH_INFO: `/v3/users/a1c60b00a3cb4c09974d1954cce11994` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.667640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c60b00a3cb4c09974d1954cce11994)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.673962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.704752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b4a4-7db0-419c-9138-5872598d2987 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:15.711334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:15.712002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:15.712564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:15.712812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:15.723745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:15.725251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:15.737497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 997/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:16.200335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:16.203998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:16.207049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c60b00a3cb4c09974d1954cce11994'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.229262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1734-98a5-47ec-b314-529edcde6af9 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:16.238006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:16.239239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:16.239903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:16.240474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] PATH_INFO: `/v3/users/a7633eb27d6c46508d04a06a5062b74a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:16.246279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7633eb27d6c46508d04a06a5062b74a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:16.247302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:16.348129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c60b00a3cb4c09974d1954cce11994'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.349338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c60b00a3cb4c09974d1954cce11994'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.351781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c60b00a3cb4c09974d1954cce11994'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.384381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd9c381d-665d-4c5a-97bf-0a75209c7e47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c60b00a3cb4c09974d1954cce11994'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.426313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 995/1992] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:15 2022] DELETE /identity/v3/users/a1c60b00a3cb4c09974d1954cce11994 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:16.434222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:16.434565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:16.435220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:16.482370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:16.484828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:16.595912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7633eb27d6c46508d04a06a5062b74a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.615490 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 996/1993] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:16.632807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:16.637200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:16.751314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7633eb27d6c46508d04a06a5062b74a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.752012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7633eb27d6c46508d04a06a5062b74a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.752655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7633eb27d6c46508d04a06a5062b74a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.769842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-171d1780-a680-4c5f-a767-98d8b0e3fee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7633eb27d6c46508d04a06a5062b74a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:16.803038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 998/1994] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:16 2022] DELETE /identity/v3/users/a7633eb27d6c46508d04a06a5062b74a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:16.812025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508339-2aac-4864-b211-00188557269f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:16.812436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508339-2aac-4864-b211-00188557269f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:16.812787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508339-2aac-4864-b211-00188557269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:16.843848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7764a79-6ee2-4050-9fe8-e9651961b3ca None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:16.874916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e1508339-2aac-4864-b211-00188557269f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:16.877584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e1508339-2aac-4864-b211-00188557269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:17.017417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:17.018503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:17.018999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:17.019468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:17.020064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 999/1995] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:17.028841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:17.051039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508339-2aac-4864-b211-00188557269f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:17.056261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e1508339-2aac-4864-b211-00188557269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:17.072977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:17.076917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:17.093688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508339-2aac-4864-b211-00188557269f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:17.112187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:17.114409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:17.115614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:17.121951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:17.127244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 997/1996] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:17.157938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:17.157938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:17.188009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1000/1997] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:17.837739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:18.030676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:18.034125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:18.121971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:18.130486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:18.137766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:18.194632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c5b-b6cd-49a0-8719-b2b316b491df service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:18.209544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:18.211378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:18.212954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:18.214447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] PATH_INFO: `/v3/projects/815f4922c38a47349f6b3bc865a1793a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:18.218374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=815f4922c38a47349f6b3bc865a1793a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:18.227868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:18.244816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd1981-99a6-443a-b263-b03da00e93ef service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:18.264593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:18.265253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:18.268030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:18.268030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:18.277657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:18.425260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:18.427284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:18.442261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 998/1998] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:18.498381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815f4922c38a47349f6b3bc865a1793a', 'request_id': 'req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:18.512987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815f4922c38a47349f6b3bc865a1793a', 'request_id': 'req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:18.550834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:18.557122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:18.601525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569794c2-e734-4dcd-8624-99b49b7c05a2 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:18.671416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815f4922c38a47349f6b3bc865a1793a', 'request_id': 'req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:18.719551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] The token cache is being invalidate because project 815f4922c38a47349f6b3bc865a1793a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:18.720116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:18.723613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:18.728532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1001/1999] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:18 2022] DELETE /identity/v3/projects/815f4922c38a47349f6b3bc865a1793a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:18.731708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:18.734938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:18.745161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:18.746266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:18.746763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:18.747191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] PATH_INFO: `/v3/projects/1a16bc46d96a409cb8a3ae03a6f61905` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:18.749445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a16bc46d96a409cb8a3ae03a6f61905)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:18.751746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:18.762647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df13fb-7c4a-46e6-a96d-b45ebbc71b4e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:18.781722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:18.782433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:18.782709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:18.783160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] PATH_INFO: `/v3/users/7410602f217541fbb5efb04a36fbf549` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:18.785846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7410602f217541fbb5efb04a36fbf549)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:18.787900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:19.241685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7410602f217541fbb5efb04a36fbf549'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.268252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a16bc46d96a409cb8a3ae03a6f61905', 'request_id': 'req-d9a5a813-11f0-4693-960e-cf6e1257f0b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.277754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a16bc46d96a409cb8a3ae03a6f61905', 'request_id': 'req-d9a5a813-11f0-4693-960e-cf6e1257f0b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.375041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7410602f217541fbb5efb04a36fbf549'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.375765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7410602f217541fbb5efb04a36fbf549'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.376532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7410602f217541fbb5efb04a36fbf549'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.395518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f33c21bb-5975-4124-85e3-6cfbb7085b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7410602f217541fbb5efb04a36fbf549'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.462922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1002/2000] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:18 2022] DELETE /identity/v3/users/7410602f217541fbb5efb04a36fbf549 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:19.478099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a16bc46d96a409cb8a3ae03a6f61905', 'request_id': 'req-d9a5a813-11f0-4693-960e-cf6e1257f0b9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.498866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] The token cache is being invalidate because project 1a16bc46d96a409cb8a3ae03a6f61905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:19.499432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.503668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9a5a813-11f0-4693-960e-cf6e1257f0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:19.506274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 999/2001] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:18 2022] DELETE /identity/v3/projects/1a16bc46d96a409cb8a3ae03a6f61905 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:19.514998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:19.519070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:19.519070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:19.574894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:19.577012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:19.771520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1003/2002] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:19.782154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:19.782451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:19.782885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:19.815562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:19.817222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:19.833443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:19.844514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1000/2003] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:19.847511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7997e-7c67-487d-b44a-01ead8eb2ac1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:19.855163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:19.856271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:19.856693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:19.857095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:19.858449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:19.859200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:19.861335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:19.884409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:19.891758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1004/2004] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:23:19.897309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4b1a3-9cf7-40d5-ab75-57274270e134 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:19.915712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:19.916367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:19.916648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:19.916904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:19.918823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:19.931556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:20.072915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1001/2005] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:20.075774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:20.098451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afbed8-17e4-411c-a48a-4c6799f0c4fe admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:20.280974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:20.282021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.282021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.282021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.282683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:20.284658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:20.442522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1005/2006] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:20 2022] POST /identity/v3/users => generated 292 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:20.444685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:20.471160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03d46-629b-45d3-ba10-bea3d9d7242a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:20.479190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:20.481059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.481592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.482295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.483553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:20.486221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:20.502989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1002/2007] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:20.509275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:20.540747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fed357-8225-4eef-85bc-08df677d88a2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:20.552642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:20.554375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.554375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.554941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.556374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:20.559488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b390dd4-9e50-4956-9960-aed347bbaba3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:20.585941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1006/2008] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:20.590947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:20.602657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da30ef-2ef7-4b1e-bbeb-880b6412f7c8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:20.610505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:20.611214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.611497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.614831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] PATH_INFO: `/v3/projects/b216c6987b174378bde93963dcd0297b/users/b811b21e6dc14049818fecf83dca683b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.632365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b216c6987b174378bde93963dcd0297b, user_id=b811b21e6dc14049818fecf83dca683b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:20.635540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:20.777817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1003/2009] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:20 2022] PUT /identity/v3/projects/b216c6987b174378bde93963dcd0297b/users/b811b21e6dc14049818fecf83dca683b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:20.783441 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:20.783861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:20.784241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:20.827380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:20.833423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:20.962811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:20.966474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:20.988869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1007/2010] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:21.028413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:21.081176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce543ba-a60e-46fa-b081-becc5f41d0f1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:21.083465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:21.085451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:21.110604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:21.114562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.115272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.116577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] PATH_INFO: `/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.122198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74913a1cafb4a97ab297c2a20eb8b41)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:21.126208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:21.189954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a75528-cc2f-44f4-ae05-72b391dfc363 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:21.196449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:21.197471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.197471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.197696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.211070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:21.213553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b52129-86de-4063-8df1-9527dffcbada service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:21.224566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1008/2011] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:21.255091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:21.430488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74913a1cafb4a97ab297c2a20eb8b41', 'request_id': 'req-1fde93f3-969d-4f18-a01f-c15e27708248'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:21.452434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74913a1cafb4a97ab297c2a20eb8b41', 'request_id': 'req-1fde93f3-969d-4f18-a01f-c15e27708248'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:21.552700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74913a1cafb4a97ab297c2a20eb8b41', 'request_id': 'req-1fde93f3-969d-4f18-a01f-c15e27708248'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:21.568068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] The token cache is being invalidate because project a74913a1cafb4a97ab297c2a20eb8b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:21.568534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:21.569618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fde93f3-969d-4f18-a01f-c15e27708248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:21.571665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1004/2012] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:20 2022] DELETE /identity/v3/projects/a74913a1cafb4a97ab297c2a20eb8b41 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:21.580544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.581182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.581373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.617078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:21.622221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:21.781015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1009/2013] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:21.792755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.793557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.794090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.834079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:21.837081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:21.869370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1005/2014] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:21.877845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:21.912539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d8906-c599-4bfa-b065-523f6e7cb951 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:21.919007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:21.920285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.920729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.921326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.932725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:21.934361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:21.936630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:21.970278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:21.976890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1010/2015] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:21.982698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a539af-0f10-4f82-802a-6cb3a60d2f03 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:21.993169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:21.994042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:21.994505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:21.994781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:21.998153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:21.999935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:22.252290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1006/2016] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:21 2022] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:22.254899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:22.334051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820f90d-5ce7-456a-bf41-5c8e28fdd7bb admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:22.522840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:22.528472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:22.529236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:22.533542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:22.535188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:22.549544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:22.763815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1011/2017] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:22 2022] POST /identity/v3/users => generated 291 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:22.777993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:22.804512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed110d-8370-4d14-a2cb-d99494e4697b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:22.823367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:22.824851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:22.825585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:22.826365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:22.828836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:22.832627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:22.863408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1007/2018] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:22.867580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:22.894302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe4b7-6624-4f2b-ae23-40a35477e77d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:22.903877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:22.906105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:22.906752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:22.907354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:22.908655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:22.912788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e52d4-8aed-491a-a544-43d9498639c5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:22.968094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1012/2019] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:22.974024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:23.000493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0cda-b9e8-474a-9587-a06fa157aeeb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:23.028364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:23.033812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.034487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.035382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] PATH_INFO: `/v3/projects/438773b07b0f4ff69850e5097731ad6c/users/6e7fdb1bfb8b439a80832585fde97515/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.071507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] RBAC: Authorizing `identity:create_grant(project_id=438773b07b0f4ff69850e5097731ad6c, user_id=6e7fdb1bfb8b439a80832585fde97515, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:23.076333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:23.194777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1008/2020] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:22 2022] PUT /identity/v3/projects/438773b07b0f4ff69850e5097731ad6c/users/6e7fdb1bfb8b439a80832585fde97515/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:23.211901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.212176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.212436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.347862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] MFA Rules not processed for user `6e7fdb1bfb8b439a80832585fde97515`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:23.356300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:23.559534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:23.640347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1013/2021] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:23.646505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:23.853494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a6234-35e8-40ef-923b-4bf106d2752a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:23.868442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:23.869094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:23.870187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:23.870692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:23.871590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:23.878563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.054568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1009/2022] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:23 2022] POST /identity/v3/projects => generated 379 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:24.055405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.075522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e445eb3-20c7-4bcd-aad0-4296397c67c4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.281034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.281732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.282058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.282331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.283516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:24.286051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.399749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1014/2023] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:24 2022] POST /identity/v3/users => generated 296 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:24.405008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.424666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5361a-da86-4bb8-9a00-3854a605f2bf admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.439514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.440156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.440587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.440921 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.441606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:24.443479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611ff29-5e4d-48bc-b4d5-172f6fd9bcef admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.483987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.497383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1010/2024] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:24.504409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dc525-1e67-489f-8209-07a577a01c06 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.510419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:24.528947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.529665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.529970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.530299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] PATH_INFO: `/v3/projects/6a51892297854d008de0e4cce2ecb7c0/users/292837e824e14fec8c59c001791e72b2/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.572196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a51892297854d008de0e4cce2ecb7c0, user_id=292837e824e14fec8c59c001791e72b2, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:24.579162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:24.627429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.627809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.628196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:24.672486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] MFA Rules not processed for user `bbb975a644ea4e9b9582b8e4b06357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:24.675042 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:24.728533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1015/2025] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:24 2022] PUT /identity/v3/projects/6a51892297854d008de0e4cce2ecb7c0/users/292837e824e14fec8c59c001791e72b2/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:24.733119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.825320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1011/2026] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:24.847390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:24.849028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:24.962381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cc4c7-0bb8-4666-9c1d-ae644523ca2d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:24.992929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:24.994689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:24.995490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:24.999039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.000677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.005661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:25.032029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1016/2027] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:25.033901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:25.048401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7c7f1-6634-455e-958d-ed4643162816 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.054501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.055193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.055476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.056130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] PATH_INFO: `/v3/projects/6a51892297854d008de0e4cce2ecb7c0/users/292837e824e14fec8c59c001791e72b2/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.064371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a51892297854d008de0e4cce2ecb7c0, user_id=292837e824e14fec8c59c001791e72b2, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.067213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb6ed0-875d-4612-ba8f-32e2a03f0a42 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:25.099240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1017/2028] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:25 2022] PUT /identity/v3/projects/6a51892297854d008de0e4cce2ecb7c0/users/292837e824e14fec8c59c001791e72b2/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:25.102506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.102506 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.102809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.122872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf59e1-547d-4d9d-ad08-54b845e26e12 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.156649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] MFA Rules not processed for user `292837e824e14fec8c59c001791e72b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:25.158128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.321405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1018/2029] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:25.328513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.330018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.331421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.331987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.340846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:25.355189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.481698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb463cf-7468-45ed-9f1e-780d409d450a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.493580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.495192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.495496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.498376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.531557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.534811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feb46e-18d6-42c4-8946-d8cf4174bed8 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:25.573664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1019/2030] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:25.576648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.579220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.581857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:25.585179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:25.586788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:25.626595 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1012/2031] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:25.685793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] MFA Rules not processed for user `b811b21e6dc14049818fecf83dca683b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:25.687112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.897188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1020/2032] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:25.921123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:25.923889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:25.951214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3c274-0fe2-44bc-8a3e-ad97f24bc87d service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:25.959750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:25.961387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:25.962513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:25.963371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:26.006762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:26.008353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:26.033553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1013/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:26.792293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:27.858489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:27.878904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851693e8-479f-4c57-8c1e-ddbe4827b75d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:27.884724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292837e824e14fec8c59c001791e72b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a51892297854d008de0e4cce2ecb7c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:27.885738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:27.886330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:27.886852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:27.889193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:27.889756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:27.891846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:27.929322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1021/2034] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:23:27.935731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:27.956635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3021-3e36-4a10-9611-50261e8641c6 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:27.968945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292837e824e14fec8c59c001791e72b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a51892297854d008de0e4cce2ecb7c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:27.969594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:27.969910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:27.970186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:27.970901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:27.973089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:28.187675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1014/2035] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:27 2022] POST /identity/v3/projects => generated 354 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:28.194383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:28.246535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c867c-8f50-47c4-bc75-360111df1819 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:28.378594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292837e824e14fec8c59c001791e72b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a51892297854d008de0e4cce2ecb7c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:28.387368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:28.387368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:28.387368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:28.387368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:28.387368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:28.391080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26da28-6319-4d07-ba9e-fd7fc391cedb tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:28.422094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1022/2036] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:28.499011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:28.511744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297194b3-1651-45dd-935d-94b9768eb175 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:28.517064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '292837e824e14fec8c59c001791e72b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a51892297854d008de0e4cce2ecb7c0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:28.517794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:28.518322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:28.518438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] PATH_INFO: `/v3/projects/39f797dce9e9479e8cf260b805ec86e4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:28.519667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39f797dce9e9479e8cf260b805ec86e4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:28.522143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:28.562949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:28.861959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f797dce9e9479e8cf260b805ec86e4', 'request_id': 'req-09080e62-3699-4d4d-971f-abe49c23c065'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.870450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f797dce9e9479e8cf260b805ec86e4', 'request_id': 'req-09080e62-3699-4d4d-971f-abe49c23c065'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:28.993584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f797dce9e9479e8cf260b805ec86e4', 'request_id': 'req-09080e62-3699-4d4d-971f-abe49c23c065'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.024349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] The token cache is being invalidate because project 39f797dce9e9479e8cf260b805ec86e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:29.024870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.026147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-09080e62-3699-4d4d-971f-abe49c23c065 tempest-VolumeQuotaClassesTest-540924492 tempest-VolumeQuotaClassesTest-540924492-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:29.036685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1015/2037] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:28 2022] DELETE /identity/v3/projects/39f797dce9e9479e8cf260b805ec86e4 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:30.080601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:30.181449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.183231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.186168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.198484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.198484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.198484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.273064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] MFA Rules not processed for user `b811b21e6dc14049818fecf83dca683b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.284493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.302142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] MFA Rules not processed for user `2a71db6cea734be0b88d03ebeb7bc144`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:30.319841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.469490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1023/2038] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:30.525137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1016/2039] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:30.526222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.529459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.725446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:30.727533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:30.750836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd16ae2-526f-4755-a0e6-ab21d5d826e7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:30.758353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:30.758613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137af86-746f-4265-9271-4f87ad9449d3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:30.759956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.760336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.760775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.762575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:30.766710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.772193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:30.773389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:30.773710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:30.774015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] PATH_INFO: `/v3/users/6e7fdb1bfb8b439a80832585fde97515` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:30.779419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7fdb1bfb8b439a80832585fde97515)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:30.782071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:30.887732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1024/2040] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/projects => generated 373 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:30.894457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.016923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70d51-629e-46f4-9f71-53e435a2138b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.030544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.032037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.032583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.033124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.034634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.040407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.172150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7fdb1bfb8b439a80832585fde97515'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:31.214547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1025/2041] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:30 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:31.215736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.268343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7fdb1bfb8b439a80832585fde97515'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:31.268945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7fdb1bfb8b439a80832585fde97515'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:31.270193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7fdb1bfb8b439a80832585fde97515'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:31.270904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e6183-fab2-410b-b80a-c75956404f80 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.285542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.287665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.288078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.289018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.290007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.292065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-abd78b78-f9ea-452b-b02a-741fec41b10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7fdb1bfb8b439a80832585fde97515'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:31.306741 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.384685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1026/2042] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:31.390790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.394334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1017/2043] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:30 2022] DELETE /identity/v3/users/6e7fdb1bfb8b439a80832585fde97515 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:31.394609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.399783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.403414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.403414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.411620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f75cc-8172-4ab1-8356-56a137223395 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.492194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:31.494108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.494980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.495764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.496206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.496559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] PATH_INFO: `/v3/projects/b734ef4da26b4728a2c010a59bc333d1/users/7571254c7457466ea5e541a5ebaf3ab8/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.539250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1018/2044] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:31.548919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.552565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b734ef4da26b4728a2c010a59bc333d1, user_id=7571254c7457466ea5e541a5ebaf3ab8, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.552700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:31.557425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee528612-0efa-44ef-b454-65e47811537d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.677750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3935-4970-4f94-870c-0bab09ce124d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.682436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:31.683162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.683551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.683834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.694850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:31.696671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:31.709792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1019/2045] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:31.802212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1027/2046] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:31 2022] PUT /identity/v3/projects/b734ef4da26b4728a2c010a59bc333d1/users/7571254c7457466ea5e541a5ebaf3ab8/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:31.805057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:31.835478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489027-ee69-4419-9a2c-f7aaf50c078c service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:31.871008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:31.871504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:31.872674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:31.919213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] MFA Rules not processed for user `bbb975a644ea4e9b9582b8e4b06357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:31.922820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:32.063350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1028/2047] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:32.102431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:32.103523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.104033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.104534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.105779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:32.110087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:32.116178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:32.148724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1020/2048] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:32.154348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:32.174995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165cf68-72dc-4728-947d-308d0cd6dfa6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:32.229390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:32.230329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:32.230489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:32.230647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] PATH_INFO: `/v3/projects/b734ef4da26b4728a2c010a59bc333d1/users/7571254c7457466ea5e541a5ebaf3ab8/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:32.242933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b734ef4da26b4728a2c010a59bc333d1, user_id=7571254c7457466ea5e541a5ebaf3ab8, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:32.246305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:32.272792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1029/2049] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:32 2022] PUT /identity/v3/projects/b734ef4da26b4728a2c010a59bc333d1/users/7571254c7457466ea5e541a5ebaf3ab8/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:33.150218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:33.156957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:33.210135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ac610-3081-4383-8ccd-b6b589675de3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:33.475083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:33.476178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:33.476683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:33.477208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] PATH_INFO: `/v3/projects/438773b07b0f4ff69850e5097731ad6c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:33.480751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=438773b07b0f4ff69850e5097731ad6c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:33.486693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:33.856754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438773b07b0f4ff69850e5097731ad6c', 'request_id': 'req-8ec574ae-8dda-4907-940a-26a5f3789a94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:33.876268 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438773b07b0f4ff69850e5097731ad6c', 'request_id': 'req-8ec574ae-8dda-4907-940a-26a5f3789a94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.088514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438773b07b0f4ff69850e5097731ad6c', 'request_id': 'req-8ec574ae-8dda-4907-940a-26a5f3789a94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.142809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] The token cache is being invalidate because project 438773b07b0f4ff69850e5097731ad6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:34.142809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.166074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.178770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1021/2050] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:33 2022] DELETE /identity/v3/projects/438773b07b0f4ff69850e5097731ad6c => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:34.186351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:34.186351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:34.229184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1fef-faad-4ef7-9dee-d05862f324bf admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:34.413918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:34.415196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:34.415713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:34.416298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] PATH_INFO: `/v3/users/292837e824e14fec8c59c001791e72b2` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:34.418703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=292837e824e14fec8c59c001791e72b2)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:34.425208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:34.642879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:34.776402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292837e824e14fec8c59c001791e72b2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.915289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292837e824e14fec8c59c001791e72b2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.919193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292837e824e14fec8c59c001791e72b2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:34.923225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292837e824e14fec8c59c001791e72b2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:35.017972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-78decda4-2109-4dc0-8a43-31b4a508d60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292837e824e14fec8c59c001791e72b2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:35.017972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1030/2051] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:34 2022] DELETE /identity/v3/users/292837e824e14fec8c59c001791e72b2 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:36.008954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:36.057835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec574ae-8dda-4907-940a-26a5f3789a94 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:36.298420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:36.301072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.301822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.302533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] PATH_INFO: `/v3/projects/6a51892297854d008de0e4cce2ecb7c0` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.308196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a51892297854d008de0e4cce2ecb7c0)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:36.313585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:36.508621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a51892297854d008de0e4cce2ecb7c0', 'request_id': 'req-f597d40a-8267-4212-a14f-9abf4ab6cb94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:36.517533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a51892297854d008de0e4cce2ecb7c0', 'request_id': 'req-f597d40a-8267-4212-a14f-9abf4ab6cb94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:36.653221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a51892297854d008de0e4cce2ecb7c0', 'request_id': 'req-f597d40a-8267-4212-a14f-9abf4ab6cb94'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:36.686946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] The token cache is being invalidate because project 6a51892297854d008de0e4cce2ecb7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:36.687514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:36.689660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f597d40a-8267-4212-a14f-9abf4ab6cb94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:36.693144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1022/2052] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:36 2022] DELETE /identity/v3/projects/6a51892297854d008de0e4cce2ecb7c0 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:36.700280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.701108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.701558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.749433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:36.770871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.906154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1031/2053] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:36.916920 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:36.917396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:36.918085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:36.955594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:36.969978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:36.977387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1023/2054] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:36.984280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:37.016824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3783f-cc17-4b10-bf42-9e2cf618b85f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.031322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.033057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.034802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.035595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.037299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:37.038734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.043155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.121744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:37.123266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1032/2055] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:37.143050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:37.168806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6103534-9d4e-4ec1-81a8-ba7c18fef85f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.176213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.192441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.192441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.192441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.192441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.192441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.356099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1024/2056] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:37 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:37.362227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:37.389137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d398b-59ff-4458-b003-f9414c184481 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.590749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.591762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.593164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.593739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.595370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.598871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.920002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1033/2057] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:37 2022] POST /identity/v3/users => generated 287 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:37.925226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:37.945371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e37d7f-0c30-46eb-bdee-50635fa8ac1e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:37.960493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:37.960493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:37.960493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:37.960493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:37.960977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:37.963100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:37.981795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1025/2058] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:37.986241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:38.004467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359bf8a-947c-401c-be0c-2514c800c4c4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:38.013783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:38.013783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:38.013783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:38.014311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:38.014665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:38.017084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f52d46-b1cd-4d4d-8c60-e7a1dbb8f5e0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:38.029548 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1034/2059] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:38.034524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:38.046283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60998da-03cb-432d-b0f8-fc80531395ed admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:38.052855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:38.053569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:38.053851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:38.054168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] PATH_INFO: `/v3/projects/5e99922bddda466e897e5a9e0f1595c0/users/05a3580176d64aea9a316f224a4fa56a/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:38.075076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e99922bddda466e897e5a9e0f1595c0, user_id=05a3580176d64aea9a316f224a4fa56a, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:38.078710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:38.214308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ecfe-8464-4624-b32b-281a0a7b23e8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:38.215127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ecfe-8464-4624-b32b-281a0a7b23e8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:38.215418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ecfe-8464-4624-b32b-281a0a7b23e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:38.218050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1026/2060] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:38 2022] PUT /identity/v3/projects/5e99922bddda466e897e5a9e0f1595c0/users/05a3580176d64aea9a316f224a4fa56a/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:38.261219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d153ecfe-8464-4624-b32b-281a0a7b23e8 None None] MFA Rules not processed for user `05a3580176d64aea9a316f224a4fa56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:38.265945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d153ecfe-8464-4624-b32b-281a0a7b23e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:38.432855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1035/2061] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:38.452976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:38.458760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:38.623294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1d5a-8254-4e82-8cbf-9f4bdbf8e7f5 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:38.632479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:38.632776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:38.633315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:38.633788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:38.665763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:38.668546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:38.688214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1027/2062] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:39.931123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:41.591336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:42.568497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:44.123623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:46.370820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:46.371297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:46.371419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:46.409827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] MFA Rules not processed for user `7571254c7457466ea5e541a5ebaf3ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:46.411176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:46.446707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:46.534648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1036/2063] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:46.540372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bbd59-cb74-4c7a-91b9-b7004ee14f18 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:46.548934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:46.550683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:46.552192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:46.552458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:46.552910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:46.553252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] PATH_INFO: `/v3/users/05a3580176d64aea9a316f224a4fa56a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:46.555047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a3580176d64aea9a316f224a4fa56a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:46.558014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:46.648847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7041c-4ef9-483a-b3ed-df5bf425ac19 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:46.655361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:46.656024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:46.656299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:46.656566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:46.659755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:46.736400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:46.737996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac97fed-40e8-4160-99ea-544687270c53 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:46.748849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1037/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:46.991895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a3580176d64aea9a316f224a4fa56a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:47.103120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a3580176d64aea9a316f224a4fa56a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:47.104248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a3580176d64aea9a316f224a4fa56a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:47.106200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a3580176d64aea9a316f224a4fa56a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:47.131724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a3580176d64aea9a316f224a4fa56a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:47.190359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1028/2065] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:23:46 2022] DELETE /identity/v3/users/05a3580176d64aea9a316f224a4fa56a => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:47.196630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:47.197112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:47.197650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:47.294152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:47.298426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:47.486950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1038/2066] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:47.536966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:47.542353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:47.547033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:47.711142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef49c0-517e-4e1c-a03b-00385634354c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:47.715202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:47.715823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:47.716126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:47.716568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:47.728784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:47.730583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f528ae-8c6f-4b03-a1c5-92dda94c4c56 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:47.744194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1029/2067] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:48.667830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:48.669958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:48.684902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5394-82a9-43b9-834e-9ab4c9843e50 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:48.698800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:48.699477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:48.699754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:48.700204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] PATH_INFO: `/v3/projects/5e99922bddda466e897e5a9e0f1595c0` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:48.703641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e99922bddda466e897e5a9e0f1595c0)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:48.709703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:48.920252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e99922bddda466e897e5a9e0f1595c0', 'request_id': 'req-02d8c082-3514-4612-922f-15058a5bbc27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:48.932227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e99922bddda466e897e5a9e0f1595c0', 'request_id': 'req-02d8c082-3514-4612-922f-15058a5bbc27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:48.997768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e99922bddda466e897e5a9e0f1595c0', 'request_id': 'req-02d8c082-3514-4612-922f-15058a5bbc27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.038332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] The token cache is being invalidate because project 5e99922bddda466e897e5a9e0f1595c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:23:49.038839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.039853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-02d8c082-3514-4612-922f-15058a5bbc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:23:49.042631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1039/2068] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:23:48 2022] DELETE /identity/v3/projects/5e99922bddda466e897e5a9e0f1595c0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:49.049342 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.049931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.049931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.077161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:49.078752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:49.254757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1030/2069] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:49.267998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.268388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.268816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.295247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:49.296782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:49.311839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1040/2070] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:49.318419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:49.342215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e359665-e47b-4ac1-81fa-b1d7691be708 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:49.352283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:49.353338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.355103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.355622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.356974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:23:49.357692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:49.360869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:49.388372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1031/2071] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:23:49.400739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:49.439777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4fa1-1368-4191-ae97-60badabaae2a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:49.453039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:49.455203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.455985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.456667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.458160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:49.463633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:49.754691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1041/2072] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/projects => generated 385 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:49.761524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:49.778077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129c6cd-912c-4329-bae1-a3985bf97f43 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:49.878074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:49.889318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:49.889318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:49.889318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:49.889318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:49.889318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.009338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1032/2073] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:49 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:50.014823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.034004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c524d5-eff4-4a4c-a534-f9a6e10a704d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.041934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.042406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.042903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.043374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.044601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.047895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.072095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1042/2074] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:50.077288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.093394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e29a0-c7cd-4be9-819b-fda2370a6150 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.103256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.104293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.110048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.111180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.112440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.115386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058bf63-ade5-46fe-872b-e567af537222 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.167538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:50.170409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.171014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1033/2075] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:50.218451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576870e8-757f-4088-bdef-4c161b14d0ff admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.244347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.245840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.251078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.253253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] PATH_INFO: `/v3/projects/c23b846115fa4dc19a1a9409e1209aa2/users/2803e3a0e8d2471bb9899cb1e3e9a2ef/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.320360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23b846115fa4dc19a1a9409e1209aa2, user_id=2803e3a0e8d2471bb9899cb1e3e9a2ef, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.325984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:50.448227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1043/2076] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:50 2022] PUT /identity/v3/projects/c23b846115fa4dc19a1a9409e1209aa2/users/2803e3a0e8d2471bb9899cb1e3e9a2ef/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:50.460887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.462288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.463038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.550130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] MFA Rules not processed for user `2803e3a0e8d2471bb9899cb1e3e9a2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:50.554419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:50.784316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1034/2077] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:50.798536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:50.886883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1905f-bbdc-4bce-bbbd-f58e92972a8c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:50.893218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:50.893955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:50.894234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:50.894510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:50.895167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:50.897209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.032286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1044/2078] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:50 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:23:51.036767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.051356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b27bd-d9e8-4b99-ac94-2c43cae9c2cf None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.187039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.188194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.193168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.193168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.193168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.202036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.313512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1035/2079] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:51 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:51.318720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.340176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0cd6f-7784-4cdc-876a-7cd82306a506 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.349723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.352222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.352640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.352904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.353625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.355346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.370392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1045/2080] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:51.374560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.388791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554a16c-4815-4b5b-ae2a-ebc87599509d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.395589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.396768 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.397231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.397795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.398690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.400660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490ebf8-bc82-4b93-ab4e-0c45130e0ca7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.419753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1036/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:51.421149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.448206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef93c-ffa5-43b9-af34-1b7cd211cd0d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.459886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.462195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.462684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.463151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] PATH_INFO: `/v3/projects/82ab35ca89154056ae62a63a02adb0dc/users/9df65b77b6044d5a908d28c1384e2af8/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.504644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ab35ca89154056ae62a63a02adb0dc, user_id=9df65b77b6044d5a908d28c1384e2af8, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.510744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:51.679409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1046/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:51 2022] PUT /identity/v3/projects/82ab35ca89154056ae62a63a02adb0dc/users/9df65b77b6044d5a908d28c1384e2af8/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:51.689809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f329f-01c5-4d0a-b95f-7a3019a3b328 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.689809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f329f-01c5-4d0a-b95f-7a3019a3b328 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.689809 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f329f-01c5-4d0a-b95f-7a3019a3b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.768547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ce8f329f-01c5-4d0a-b95f-7a3019a3b328 None None] MFA Rules not processed for user `9df65b77b6044d5a908d28c1384e2af8`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:51.774109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ce8f329f-01c5-4d0a-b95f-7a3019a3b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:51.874270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1037/2083] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:51.879792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:51.979332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add7b28-a006-4eba-9d0f-3317cd75d208 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:51.987901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:51.988963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:51.989454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:51.989927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:51.992270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:51.995176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.115203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.115910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.116566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.154898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] MFA Rules not processed for user `2a71db6cea734be0b88d03ebeb7bc144`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:52.158627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:52.160981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1047/2084] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:23:51 2022] POST /identity/v3/projects => generated 383 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:52.166621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:52.283712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf386f-d58a-4dff-b2e5-9248aaf27c97 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:52.287758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1038/2085] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:23:52.290572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:52.291455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.291934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.292309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.293231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:52.295463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.396622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1048/2086] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:23:52 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:23:52.402401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:52.431381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a4d91-9293-4e17-8a7b-f4a0e8317286 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:52.446279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:52.447964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.449220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.450211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.452165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:52.456345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.488592 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1039/2087] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:23:52.489628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:52.504312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2f602-3a49-4f28-bb2d-c3923d3bb7d6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:52.509803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:52.511386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.511386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.511386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] PATH_INFO: `/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2/users/429e42dbd9be48bb9024cf7b366f28f1/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.551517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce444635dc440b9b1e4c3a6aec382f2, user_id=429e42dbd9be48bb9024cf7b366f28f1, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:52.557711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.686196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1049/2088] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:52 2022] PUT /identity/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2/users/429e42dbd9be48bb9024cf7b366f28f1/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:23:52.691121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:52.704760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e2b4-6dc2-4f92-a16b-15d5f7fb18ad admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:52.779414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:52.780050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.780333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.780607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.781272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:52.783567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdf381-4dff-44db-b1ef-d92ba0d5602a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.795491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1040/2089] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:23:52.800439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:52.812460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9567b-63e8-41e3-af8d-d7dda7cec809 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:52.817791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:52.818517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.818801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.819077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] PATH_INFO: `/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2/users/429e42dbd9be48bb9024cf7b366f28f1/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.821212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce444635dc440b9b1e4c3a6aec382f2, user_id=429e42dbd9be48bb9024cf7b366f28f1, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:52.824089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:52.841706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1050/2090] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:23:52 2022] PUT /identity/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2/users/429e42dbd9be48bb9024cf7b366f28f1/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:23:52.854221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:52.854658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:52.855030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:52.897157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] MFA Rules not processed for user `429e42dbd9be48bb9024cf7b366f28f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:23:52.898608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:52.999183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1041/2091] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:23:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:23:53.015206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:53.018156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:53.124281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f8dae1-4605-4273-97a1-759c4a70f5f6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:53.130902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:53.131556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:53.131841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:53.132118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:53.234003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:53.236987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:53.262998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1051/2092] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:54.068712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:54.584506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:56.813148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:56.816174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:23:56.833401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dd6ee-4428-4578-86e3-3f8eb342dac4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:56.838816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:56.838816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:56.838816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:56.838816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:56.910047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:56.912174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:56.926409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1042/2093] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:23:57.920034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:59.330192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:23:59.340605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b6f54-b10d-47e8-9b70-ff17b1f26efb service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:23:59.345390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:23:59.347316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:23:59.347804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:23:59.348269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:23:59.366685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:23:59.369698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:23:59.392697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1052/2094] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:23:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:23:59.978388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:00.769856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:00.772541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:00.887683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca9c85-26d6-4061-a4e3-69f3fcda8141 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:00.887683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:00.887683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:00.887683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:00.888060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] PATH_INFO: `/v3/users/c54e848a26a84f9a9ad953deeffc5c09` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:00.888601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54e848a26a84f9a9ad953deeffc5c09)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:00.892662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:01.223276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:01.311985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54e848a26a84f9a9ad953deeffc5c09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:01.446509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54e848a26a84f9a9ad953deeffc5c09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:01.449541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54e848a26a84f9a9ad953deeffc5c09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:01.450504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54e848a26a84f9a9ad953deeffc5c09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:01.465666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54e848a26a84f9a9ad953deeffc5c09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:01.497167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1043/2095] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:00 2022] DELETE /identity/v3/users/c54e848a26a84f9a9ad953deeffc5c09 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:02.103215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:02.141459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147c7d8-eada-4614-836c-f17032514430 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:02.236097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:02.237074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:02.237074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:02.238294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] PATH_INFO: `/v3/projects/ee0d5c8cd6524c50a7c04d90362a5cd7` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:02.239534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0d5c8cd6524c50a7c04d90362a5cd7)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:02.242120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:02.371325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0d5c8cd6524c50a7c04d90362a5cd7', 'request_id': 'req-39f20906-377d-4f8a-b2d8-41e428e165ea'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.378529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0d5c8cd6524c50a7c04d90362a5cd7', 'request_id': 'req-39f20906-377d-4f8a-b2d8-41e428e165ea'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.470333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0d5c8cd6524c50a7c04d90362a5cd7', 'request_id': 'req-39f20906-377d-4f8a-b2d8-41e428e165ea'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.485375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] The token cache is being invalidate because project ee0d5c8cd6524c50a7c04d90362a5cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:02.485677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.486361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39f20906-377d-4f8a-b2d8-41e428e165ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.488874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1053/2096] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:02 2022] DELETE /identity/v3/projects/ee0d5c8cd6524c50a7c04d90362a5cd7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:02.494203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:02.498061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:02.512986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b019-f9d9-4b1b-b239-14c99b1e2e65 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:02.582881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:02.583522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:02.583798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:02.584072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] PATH_INFO: `/v3/users/0057378076c043e99df43bc55d4b45e3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:02.585265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0057378076c043e99df43bc55d4b45e3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:02.587332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:02.847171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0057378076c043e99df43bc55d4b45e3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.961005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0057378076c043e99df43bc55d4b45e3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.961729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0057378076c043e99df43bc55d4b45e3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.962500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0057378076c043e99df43bc55d4b45e3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:02.977075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0057378076c043e99df43bc55d4b45e3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.000524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1044/2097] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:02 2022] DELETE /identity/v3/users/0057378076c043e99df43bc55d4b45e3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:03.060305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210174-b2c9-46a2-aaef-97bc21ae766e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.060992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210174-b2c9-46a2-aaef-97bc21ae766e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.061638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed210174-b2c9-46a2-aaef-97bc21ae766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.086919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ed210174-b2c9-46a2-aaef-97bc21ae766e None None] MFA Rules not processed for user `0705d79d87ee4adc913a4266c2f3139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:03.090924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ed210174-b2c9-46a2-aaef-97bc21ae766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:03.184023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1054/2098] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:03.289530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:03.291550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:03.379609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65ed32-dec3-48dd-9922-d1b7d07fede3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:03.384784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:03.386598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.387005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.387409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] PATH_INFO: `/v3/projects/273bde5e80ef458ba118fadb5705f384` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.389401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273bde5e80ef458ba118fadb5705f384)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:03.393688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:03.487415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:03.568993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273bde5e80ef458ba118fadb5705f384', 'request_id': 'req-42f94a8d-45b2-40e1-b890-58a8f93ecce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.586958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273bde5e80ef458ba118fadb5705f384', 'request_id': 'req-42f94a8d-45b2-40e1-b890-58a8f93ecce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.647785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:03.675120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273bde5e80ef458ba118fadb5705f384', 'request_id': 'req-42f94a8d-45b2-40e1-b890-58a8f93ecce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.687800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] The token cache is being invalidate because project 273bde5e80ef458ba118fadb5705f384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:03.688085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.688749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-42f94a8d-45b2-40e1-b890-58a8f93ecce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:03.690383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1045/2099] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:03 2022] DELETE /identity/v3/projects/273bde5e80ef458ba118fadb5705f384 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:03.695884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.696165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.696465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.718195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:03.719481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:03.786929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1055/2100] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:03.795569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.795853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.796125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.823605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:03.825788 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:03.836795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1046/2101] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:03.841080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:03.852701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a20d-acdc-45d4-8ef2-b8e7f2e8af2e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:03.858008 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:03.858701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.858984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.859251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.859911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:24:03.860213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:03.861930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:03.877046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1056/2102] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:24:03.881771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:03.891524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43a83-0495-49b7-be9e-1dd2bfcbd1f7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:03.896949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:03.897958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:03.898241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:03.898509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:03.899135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:03.901329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.038350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1047/2103] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:24:03 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:04.042856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.054973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0572752-73d4-4a32-86e8-28deb79ca846 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.130701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.131252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.131677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.131957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.132606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.134919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.180298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:04.261232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1057/2104] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:24:04 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:24:04.266757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.278438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b02f91-ad46-4408-9864-773cc742b7f8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.284492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.286384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.286908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.287486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.288290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.291543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.311825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1048/2105] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:24:04.316445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.328430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab60e-0a60-44a7-ade1-7e518e63d57c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.335158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.336131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.336445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.336731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.337431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.339193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34762-f646-4ce1-b112-0e05161186de admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.353048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1058/2106] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:24:04.358668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.375602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22bc8a-b59e-4fd6-ba36-31bf1b8a39e2 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.382348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.383233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.383808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.384192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] PATH_INFO: `/v3/projects/649db7795b5e47dfa3b6ca2c94c5c0b6/users/08daf528e9aa4db2805fc3f0e191e18e/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.411054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649db7795b5e47dfa3b6ca2c94c5c0b6, user_id=08daf528e9aa4db2805fc3f0e191e18e, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.414105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.522447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1049/2107] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:24:04 2022] PUT /identity/v3/projects/649db7795b5e47dfa3b6ca2c94c5c0b6/users/08daf528e9aa4db2805fc3f0e191e18e/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:04.533954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.534777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.535037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.570984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] MFA Rules not processed for user `08daf528e9aa4db2805fc3f0e191e18e`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:04.572511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:04.671478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1059/2108] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:04.683773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.694239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:04.751352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b60c8-d73d-419a-889c-0431a045cd27 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.756213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.756829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.757104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.757401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.766793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.768206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a537ce8-a240-44dc-a676-5173f062ca51 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:04.777824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1050/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:04.800178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:04.890167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3bec3-4c0a-4271-a6c6-b96b366c85ca None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:04.896147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:04.896927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:04.901749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:04.901749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] PATH_INFO: `/v3/users/08daf528e9aa4db2805fc3f0e191e18e` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:04.901749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08daf528e9aa4db2805fc3f0e191e18e)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:04.901749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:05.194195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08daf528e9aa4db2805fc3f0e191e18e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:05.320783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08daf528e9aa4db2805fc3f0e191e18e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:05.321414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08daf528e9aa4db2805fc3f0e191e18e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:05.322170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08daf528e9aa4db2805fc3f0e191e18e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:05.329832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08daf528e9aa4db2805fc3f0e191e18e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:05.333038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:05.349602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1060/2110] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:04 2022] DELETE /identity/v3/users/08daf528e9aa4db2805fc3f0e191e18e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:05.354188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:05.354188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:05.354690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:05.374866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:05.376083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:05.443329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1051/2111] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:05.454033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:05.455635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:05.516364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2144fd-9279-4b16-a7e5-66c8c5ea78c4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:05.520433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:05.521267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:05.521647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:05.522060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:05.532289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:05.533745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:05.545739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1061/2112] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:05.980144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:05.982563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:05.995026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79751b-7a2d-4918-b7cb-7ec52f1373c4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.002425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.003254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.003724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.004319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] PATH_INFO: `/v3/users/2803e3a0e8d2471bb9899cb1e3e9a2ef` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.006431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2803e3a0e8d2471bb9899cb1e3e9a2ef)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.009191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:06.134023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:06.140262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:06.145372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:06.155908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966abc22-ad5a-40dc-ab05-d8e04519f6b0 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.161434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.162172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.162783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.163203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] PATH_INFO: `/v3/projects/649db7795b5e47dfa3b6ca2c94c5c0b6` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.164909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649db7795b5e47dfa3b6ca2c94c5c0b6)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.167232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:06.278376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2803e3a0e8d2471bb9899cb1e3e9a2ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.309511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649db7795b5e47dfa3b6ca2c94c5c0b6', 'request_id': 'req-859fc63f-0dbe-4462-9d53-c510db7496f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.320375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649db7795b5e47dfa3b6ca2c94c5c0b6', 'request_id': 'req-859fc63f-0dbe-4462-9d53-c510db7496f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.395974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2803e3a0e8d2471bb9899cb1e3e9a2ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.396551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2803e3a0e8d2471bb9899cb1e3e9a2ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.397188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2803e3a0e8d2471bb9899cb1e3e9a2ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.404936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-23bbd229-6cf8-4820-845c-cf235c9aa574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2803e3a0e8d2471bb9899cb1e3e9a2ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.428299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1052/2113] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:05 2022] DELETE /identity/v3/users/2803e3a0e8d2471bb9899cb1e3e9a2ef => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:06.430125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.430415 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.430692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.450670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:06.451879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:06.486712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649db7795b5e47dfa3b6ca2c94c5c0b6', 'request_id': 'req-859fc63f-0dbe-4462-9d53-c510db7496f6'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.504732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] The token cache is being invalidate because project 649db7795b5e47dfa3b6ca2c94c5c0b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:06.505150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.506116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-859fc63f-0dbe-4462-9d53-c510db7496f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:06.507637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1062/2114] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:06 2022] DELETE /identity/v3/projects/649db7795b5e47dfa3b6ca2c94c5c0b6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:06.512258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c537e6-e758-4d98-a748-c181f38f5e7a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.512619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c537e6-e758-4d98-a748-c181f38f5e7a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.512799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c537e6-e758-4d98-a748-c181f38f5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.519443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1053/2115] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:06.530319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:06.532064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:06.540102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-67c537e6-e758-4d98-a748-c181f38f5e7a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:06.541327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-67c537e6-e758-4d98-a748-c181f38f5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:06.549363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1063/2116] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:06.557770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.558097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.558369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.578904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:06.580163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:06.588412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1064/2117] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:06.592615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:06.592951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091836e-1454-4bc9-91f2-00f63d040400 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.597072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.597708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.598223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.598503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.602158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27c2a2-861c-4422-9de7-ae99a09d7fec None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.617411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.623904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.623904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.624962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.625066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.625066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:24:06.625066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.625382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:06.625478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:06.636452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1065/2118] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:24:06.638272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1054/2119] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:24:06.640799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:06.652282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e3d25-3116-4c02-9b43-187dfdf0f32a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.658815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.658815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.659056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.659503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.660352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.663019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:06.835237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1066/2120] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:24:06 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:24:06.840073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:06.850837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba103e7f-0203-402d-a613-d0ccdd257267 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:06.917354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:06.918027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:06.918356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:06.918657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:06.919446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:06.922183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.026892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1055/2121] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:24:06 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:07.031781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.044555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae549-8178-4cc1-bd2c-3dfd61e33221 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.049602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.050426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.050743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.051673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.052667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.054413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.065624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1067/2122] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:24:07.070198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.080728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093f41-81f1-4781-825e-0f9d4182d0b2 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.087108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.088035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.088352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.088627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.089322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.091273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9647c4-dfed-4bbf-a8ee-ff0c13a6995c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.108062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1056/2123] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:24:07.112033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.131567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c5c10-5678-4133-8458-b2d47bb26806 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.139445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.140623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.141154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.141674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] PATH_INFO: `/v3/projects/71674f2ac34f44b88ab1facee4d75120/users/520e721094b8461e9cf45d4c5f00a7f3/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.167769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71674f2ac34f44b88ab1facee4d75120, user_id=520e721094b8461e9cf45d4c5f00a7f3, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.176848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.271163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1068/2124] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:24:07 2022] PUT /identity/v3/projects/71674f2ac34f44b88ab1facee4d75120/users/520e721094b8461e9cf45d4c5f00a7f3/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:07.281553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.281839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.282139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.322599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] MFA Rules not processed for user `520e721094b8461e9cf45d4c5f00a7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:07.324118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:07.407120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1057/2125] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:07.420401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.422243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:07.437832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.439617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:07.490981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da207f15-09d7-4cd4-b0a2-c54c4f8855a7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.494889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.495539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.495842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.496132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.506255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.507731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.518225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1069/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:07.527995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:07.529540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b770a-ba8e-4f01-a1ec-1d8069fc576b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.535043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.536282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.536662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.536886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] PATH_INFO: `/v3/projects/c23b846115fa4dc19a1a9409e1209aa2` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.538069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23b846115fa4dc19a1a9409e1209aa2)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.540087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:07.675090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23b846115fa4dc19a1a9409e1209aa2', 'request_id': 'req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:07.681443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23b846115fa4dc19a1a9409e1209aa2', 'request_id': 'req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:07.704625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:07.806787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23b846115fa4dc19a1a9409e1209aa2', 'request_id': 'req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:07.821053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] The token cache is being invalidate because project c23b846115fa4dc19a1a9409e1209aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:07.821388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:07.822081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:07.823586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1058/2127] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:07 2022] DELETE /identity/v3/projects/c23b846115fa4dc19a1a9409e1209aa2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:07.827742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:07.839125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec944266-93a6-4a7c-bd4b-bf11751b2839 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:07.896010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:07.896879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:07.897124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:07.897396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] PATH_INFO: `/v3/users/9df65b77b6044d5a908d28c1384e2af8` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:07.898740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df65b77b6044d5a908d28c1384e2af8)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:07.900696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:08.121916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df65b77b6044d5a908d28c1384e2af8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:08.241335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df65b77b6044d5a908d28c1384e2af8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:08.241898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df65b77b6044d5a908d28c1384e2af8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:08.242648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df65b77b6044d5a908d28c1384e2af8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:08.251109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df65b77b6044d5a908d28c1384e2af8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:08.276710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1070/2128] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:07 2022] DELETE /identity/v3/users/9df65b77b6044d5a908d28c1384e2af8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:09.147712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:09.149297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:09.169030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1792-6e96-4eb0-a6ec-4a70da9b23a4 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:09.257231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:09.257905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:09.258260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:09.258508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] PATH_INFO: `/v3/projects/82ab35ca89154056ae62a63a02adb0dc` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:09.262886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ab35ca89154056ae62a63a02adb0dc)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:09.265427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:09.408444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ab35ca89154056ae62a63a02adb0dc', 'request_id': 'req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:09.422177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ab35ca89154056ae62a63a02adb0dc', 'request_id': 'req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:09.528472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ab35ca89154056ae62a63a02adb0dc', 'request_id': 'req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:09.558283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] The token cache is being invalidate because project 82ab35ca89154056ae62a63a02adb0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:09.559041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:09.561566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:09.566646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1059/2129] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:09 2022] DELETE /identity/v3/projects/82ab35ca89154056ae62a63a02adb0dc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:09.577353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:09.579128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:09.594436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383f8c9-aa8e-4724-a0eb-74563d67e201 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:09.665594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:09.666292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:09.666572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:09.666843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] PATH_INFO: `/v3/users/429e42dbd9be48bb9024cf7b366f28f1` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:09.668116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429e42dbd9be48bb9024cf7b366f28f1)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:09.670281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:09.821543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.928002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.947334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429e42dbd9be48bb9024cf7b366f28f1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.030041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429e42dbd9be48bb9024cf7b366f28f1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.030754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429e42dbd9be48bb9024cf7b366f28f1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.031396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429e42dbd9be48bb9024cf7b366f28f1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.044549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9c64af8f-d161-4707-be69-a245d5719f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429e42dbd9be48bb9024cf7b366f28f1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.069274 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1071/2130] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:09 2022] DELETE /identity/v3/users/429e42dbd9be48bb9024cf7b366f28f1 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:10.535258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:10.537198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:10.554255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8060c-9a5c-43ea-ade1-2d92fa2d468b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:10.626300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:10.626839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:10.627120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:10.627392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] PATH_INFO: `/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:10.628540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce444635dc440b9b1e4c3a6aec382f2)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:10.630643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:10.803210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce444635dc440b9b1e4c3a6aec382f2', 'request_id': 'req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.811079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce444635dc440b9b1e4c3a6aec382f2', 'request_id': 'req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.923390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce444635dc440b9b1e4c3a6aec382f2', 'request_id': 'req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.935230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] The token cache is being invalidate because project 2ce444635dc440b9b1e4c3a6aec382f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:10.935713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.936407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3b77fa9a-17f6-48ff-a68e-d5202fa1f521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:10.938563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1060/2131] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:10 2022] DELETE /identity/v3/projects/2ce444635dc440b9b1e4c3a6aec382f2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:10.947271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:10.947691 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:10.947925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:10.997245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:10.998542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:11.066815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1072/2132] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:11.076027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.076314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.076644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.097356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:11.098702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:11.109419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1061/2133] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:11.121991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.140410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacec87c-8c98-4dfa-a294-c2b135cad1d1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.145319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.146624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.146911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.147190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.147867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:24:11.148169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.149846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.162566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1073/2134] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:24:11.167384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.178309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca504c-c360-44a6-8daa-353621ca3e9d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.185061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.185061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.185500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.186021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.186689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.189677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.291395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1062/2135] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:24:11 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:11.295997 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.307609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a4180-a9c5-47eb-a444-488fc665162c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.387581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.388373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.388552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.388815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.389472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.391528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.397528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:11.530041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1074/2136] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:24:11 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:11.534968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.549212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7476d89-138f-465d-ab3e-4a4280112e30 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.555090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.555830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.556173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.556507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.557229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.558962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.571073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1063/2137] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:24:11.577036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.590359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c3c6-848a-4a83-856e-5485d5c8274f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.595588 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.596203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.596496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.596739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.597381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.599863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126df62-4ce2-4b9f-ba60-15e564be7ec8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.613278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1075/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:24:11.621023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.632117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325146e-d805-4983-9607-91bf092e8d5a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:11.637092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:11.637762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.638079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.638357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] PATH_INFO: `/v3/projects/2708a8440027459d8c400d968164056e/users/376d4a962da54245ae7808cf18fcd6ee/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.658090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2708a8440027459d8c400d968164056e, user_id=376d4a962da54245ae7808cf18fcd6ee, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:11.660794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:11.791773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1064/2139] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:24:11 2022] PUT /identity/v3/projects/2708a8440027459d8c400d968164056e/users/376d4a962da54245ae7808cf18fcd6ee/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:11.803440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:11.803754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:11.804028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:11.835205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] MFA Rules not processed for user `376d4a962da54245ae7808cf18fcd6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:11.836962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:11.911446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1076/2140] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:11.928294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:11.930093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:12.002262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098fd2e-c9dc-4e77-bc77-317045a41e66 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:12.006944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:12.007639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:12.007990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:12.008326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:12.021789 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:12.023966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94611abf-fee0-49c8-a34c-855129362d1e service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:12.036368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1065/2141] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:24:12.310744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:14.002724 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:14.489013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:15.077417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:16.043047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:16.123350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.231983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.377303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:17.377303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:17.457205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651849ec-7af6-4a03-bca7-d8d0d48a7a3f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:17.462144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:17.462788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:17.463067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:17.463366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] PATH_INFO: `/v3/users/520e721094b8461e9cf45d4c5f00a7f3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:17.464551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=520e721094b8461e9cf45d4c5f00a7f3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:17.466537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:17.608898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.662018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520e721094b8461e9cf45d4c5f00a7f3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:17.746914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520e721094b8461e9cf45d4c5f00a7f3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:17.747695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520e721094b8461e9cf45d4c5f00a7f3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:17.748327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520e721094b8461e9cf45d4c5f00a7f3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:17.756403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520e721094b8461e9cf45d4c5f00a7f3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:17.775007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1077/2142] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:17 2022] DELETE /identity/v3/users/520e721094b8461e9cf45d4c5f00a7f3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:17.780109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:17.780520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:17.780884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:17.801357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:17.802629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:17.864823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1066/2143] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:17.877451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:17.882575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:17.946269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cafa535-9518-4b6b-b3c4-5d2b28706b8c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:17.950807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:17.951632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:17.951924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:17.952202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:17.963960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:17.968831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb732f-49ad-4eff-aff5-b8d2d3d456ff service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:17.977162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1078/2144] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:24:18.026586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.358045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.398323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:18.533211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:18.534658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:18.548351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c7f9e-91c1-4760-ad2a-2c978359c41f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:18.553085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:18.553729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:18.554059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:18.554436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] PATH_INFO: `/v3/projects/71674f2ac34f44b88ab1facee4d75120` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:18.555627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=71674f2ac34f44b88ab1facee4d75120)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:18.557546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:18.673727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71674f2ac34f44b88ab1facee4d75120', 'request_id': 'req-f11f3df4-422e-4576-b105-ff18d09903fa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:18.680288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71674f2ac34f44b88ab1facee4d75120', 'request_id': 'req-f11f3df4-422e-4576-b105-ff18d09903fa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:18.757806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71674f2ac34f44b88ab1facee4d75120', 'request_id': 'req-f11f3df4-422e-4576-b105-ff18d09903fa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:18.768638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] The token cache is being invalidate because project 71674f2ac34f44b88ab1facee4d75120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:18.768915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:18.769524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f11f3df4-422e-4576-b105-ff18d09903fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:18.771039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1067/2145] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:18 2022] DELETE /identity/v3/projects/71674f2ac34f44b88ab1facee4d75120 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:18.776639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:18.777145 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:18.777270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:18.797482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:18.798711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:18.862188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1079/2146] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:18.869980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:18.870267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:18.870541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:18.890652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:18.891865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:18.900474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1068/2147] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:18.905431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:18.916941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce118699-b641-4816-be10-22ea7fd42081 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:18.921728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:18.922363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:18.922643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:18.922912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:18.923583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:24:18.923929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:18.925478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:18.937710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1080/2148] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:24:18.942362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:18.952324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd8db0-7cc0-44bf-b9c6-6b858d85a987 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:18.957077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:18.957679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:18.957993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:18.958264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:18.958954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:18.961499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.057182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1069/2149] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:24:18 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:19.062335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:19.073841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f968f-2e12-4b20-8224-cfc3feb8c7ab admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:19.148469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:19.149275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.149690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.152157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.153540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:19.156582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.248930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1081/2150] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:24:19 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:24:19.253154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:19.269545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9bab-15db-4656-86d8-e3e590385bfd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:19.280232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:19.280905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.281197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.281706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.282442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:19.284537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.297153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1070/2151] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:24:19.301262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:19.312746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9422a-56c7-45b4-906b-523ab9e30667 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:19.317898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:19.318754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.319101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.319445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.320713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:19.323136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60696c89-3e7b-4789-923a-5263608e027d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.336652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1082/2152] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:24:19.342380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:19.353150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac8e28-3f06-452d-900f-e162407c8b47 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:19.358406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:19.359079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.359358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.361409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] PATH_INFO: `/v3/projects/f6bc4d79724747a68f05f68e3b48c719/users/5a831d148b144eeaa3fa1c402f6f59e6/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.379431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bc4d79724747a68f05f68e3b48c719, user_id=5a831d148b144eeaa3fa1c402f6f59e6, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:19.383067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.465428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1071/2153] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:24:19 2022] PUT /identity/v3/projects/f6bc4d79724747a68f05f68e3b48c719/users/5a831d148b144eeaa3fa1c402f6f59e6/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:24:19.472070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaf2e6-daca-4c8c-a73a-d991c091b522 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.472645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaf2e6-daca-4c8c-a73a-d991c091b522 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.473207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daaf2e6-daca-4c8c-a73a-d991c091b522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.509475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8daaf2e6-daca-4c8c-a73a-d991c091b522 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:19.514923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:19.518161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8daaf2e6-daca-4c8c-a73a-d991c091b522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:19.603184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1083/2154] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:24:19.614031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:19.616400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:19.640148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:19.691870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f0dc3-9327-4bc9-926c-6ae39d529b16 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:19.696244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:19.696875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:19.697152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:19.697421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:19.707736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:19.709195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:19.724331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1072/2155] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:24:20.958653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.016031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:21.385360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d12f7-22dc-4761-9863-07fd676f7bd9 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:21.385828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d12f7-22dc-4761-9863-07fd676f7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:21.386319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d12f7-22dc-4761-9863-07fd676f7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:21.431505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3b4d12f7-22dc-4761-9863-07fd676f7bd9 None None] MFA Rules not processed for user `5a831d148b144eeaa3fa1c402f6f59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:21.432725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3b4d12f7-22dc-4761-9863-07fd676f7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:21.509561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1084/2156] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:21.527075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:21.528632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:21.590580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a1bf-e3ed-422c-b538-b92503c22296 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:21.594168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:21.594786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:21.595084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:21.595353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:21.605791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:21.607702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:21.619748 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1073/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:24.742036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa89c-7f33-48f6-ba3c-988b1c07d755 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:24.742714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa89c-7f33-48f6-ba3c-988b1c07d755 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:24.742714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fa89c-7f33-48f6-ba3c-988b1c07d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:24.764632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dc4fa89c-7f33-48f6-ba3c-988b1c07d755 None None] MFA Rules not processed for user `5a831d148b144eeaa3fa1c402f6f59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:24.765998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dc4fa89c-7f33-48f6-ba3c-988b1c07d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:24.774961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1085/2158] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:25.400329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:25.526315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:28.916261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:29.150388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:30.689634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:30.744084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:31.822696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:31.826089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:31.847473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db309-2693-4b22-9257-b6e726bc7931 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:31.851935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:31.853136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:31.853420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:31.853695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] PATH_INFO: `/v3/users/376d4a962da54245ae7808cf18fcd6ee` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:31.855251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376d4a962da54245ae7808cf18fcd6ee)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:31.857833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:32.160826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376d4a962da54245ae7808cf18fcd6ee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:32.229367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376d4a962da54245ae7808cf18fcd6ee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:32.229958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376d4a962da54245ae7808cf18fcd6ee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:32.231582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376d4a962da54245ae7808cf18fcd6ee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:32.277131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376d4a962da54245ae7808cf18fcd6ee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:32.306586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1074/2159] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:24:31 2022] DELETE /identity/v3/users/376d4a962da54245ae7808cf18fcd6ee => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:32.312664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:32.319231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:32.319729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:32.367386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:32.369778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:32.475856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1086/2160] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:32.486364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:32.488231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:32.516470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:32.585907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ff36-8a20-48a0-afaa-9f2f13a5b670 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:32.591000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:32.591683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:32.592128 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:32.592406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:32.603230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:32.604790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c51051-8d18-41ff-8a53-deb1277fdf58 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:32.616436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1075/2161] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:33.494409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:33.497314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:33.525674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6eebc-155a-4dc6-9c0d-88aea36bad76 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:33.530075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:33.531390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:33.531672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:33.531948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] PATH_INFO: `/v3/projects/2708a8440027459d8c400d968164056e` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:33.533238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2708a8440027459d8c400d968164056e)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:33.535729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:33.803853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2708a8440027459d8c400d968164056e', 'request_id': 'req-e48a1849-6cbe-4da1-8857-bf77ee8416ff'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:33.812804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2708a8440027459d8c400d968164056e', 'request_id': 'req-e48a1849-6cbe-4da1-8857-bf77ee8416ff'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:33.875202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2708a8440027459d8c400d968164056e', 'request_id': 'req-e48a1849-6cbe-4da1-8857-bf77ee8416ff'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:33.879142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:33.896614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] The token cache is being invalidate because project 2708a8440027459d8c400d968164056e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:24:33.897370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:33.898601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:24:33.901785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1087/2162] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:24:33 2022] DELETE /identity/v3/projects/2708a8440027459d8c400d968164056e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:24:34.137676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:39.433004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde786e-fa9f-4737-97b0-b099e858d57d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:39.433783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde786e-fa9f-4737-97b0-b099e858d57d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:39.434270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde786e-fa9f-4737-97b0-b099e858d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:39.459849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-abde786e-fa9f-4737-97b0-b099e858d57d None None] MFA Rules not processed for user `46b27047a70c437e8ff046a02a0db8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:39.461099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-abde786e-fa9f-4737-97b0-b099e858d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:39.541146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1076/2163] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:24:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:43.531711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:43.533249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:43.621344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a1849-6cbe-4da1-8857-bf77ee8416ff admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:43.626901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:43.627544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:43.627824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:43.628101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:43.630082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:43.644881 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:43.651409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:43.658757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1088/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:48.469242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:48.469978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:48.469978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:48.493014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:48.503630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:48.505172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:48.595661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1077/2165] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:48.638152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:48.639726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:48.724066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300e0dd-00b2-4181-a8d4-dcc8d9cf1867 service placement] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:48.729773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:48.730420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:48.730703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:48.730996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:48.739723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:48.741340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0a34-1573-4dbe-a187-ddc143ba565e service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:48.755686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1089/2166] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:49.620906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:49.622484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:49.765607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdff32-428f-4565-a65c-7e9f5e2f3339 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:49.774245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:49.775231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:49.775513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:49.777115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:49.779313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:49.869431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:49.870884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:49.885330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1078/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:24:55.999448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0742b4-4663-4688-a23f-198deea692a4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:56.000425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0742b4-4663-4688-a23f-198deea692a4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:56.000945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0742b4-4663-4688-a23f-198deea692a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:56.050198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4e0742b4-4663-4688-a23f-198deea692a4 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:56.051437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4e0742b4-4663-4688-a23f-198deea692a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:56.152763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1090/2168] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:24:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:56.209604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:56.211831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:56.285123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:56.302605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82075e14-835b-4051-8984-ce06743902e7 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:56.308028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:56.309922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:56.309922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:56.310198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:56.319612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:56.321305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:56.330585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1079/2169] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:24:57.118783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529af9e-225b-4c91-9b1b-9e37aa0e1b20 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:57.119269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529af9e-225b-4c91-9b1b-9e37aa0e1b20 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:57.119366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529af9e-225b-4c91-9b1b-9e37aa0e1b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:57.144122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0529af9e-225b-4c91-9b1b-9e37aa0e1b20 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:24:57.145608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0529af9e-225b-4c91-9b1b-9e37aa0e1b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:57.155589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1091/2170] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:24:57.181270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:24:57.186319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:24:57.229208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf354-b534-448e-a639-d9a72e3d87bb service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:24:57.240731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:24:57.250580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:24:57.251272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:24:57.251894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:24:57.280286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:24:57.283644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dd032-be15-4ad2-b111-b13332551330 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:24:57.305273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1080/2171] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:06.101538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:06.102258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:06.102258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:06.112450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:DELETE=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:06.130834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] MFA Rules not processed for user `5a831d148b144eeaa3fa1c402f6f59e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:06.132319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:06.236029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1092/2172] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:07.296772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=12 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:07.364052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb15-8cf8-4fbc-bcaf-19d8b5e7cd1c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:07.365315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb15-8cf8-4fbc-bcaf-19d8b5e7cd1c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:07.366131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37fb15-8cf8-4fbc-bcaf-19d8b5e7cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:07.494275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-6c37fb15-8cf8-4fbc-bcaf-19d8b5e7cd1c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:07.505393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6c37fb15-8cf8-4fbc-bcaf-19d8b5e7cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:07.538816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1081/2173] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:07.564694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:07.606014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8be66-ecf5-48b1-8ace-185189f563c8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:07.628928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:07.632328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:07.632328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:07.632328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:07.652743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:07.656804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:07.692825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1093/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:14.344471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af422e-ce50-4831-89bc-bc5517f21948 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:14.345516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af422e-ce50-4831-89bc-bc5517f21948 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:14.346050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af422e-ce50-4831-89bc-bc5517f21948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:14.367984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-58af422e-ce50-4831-89bc-bc5517f21948 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:14.369208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-58af422e-ce50-4831-89bc-bc5517f21948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:14.380507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1082/2175] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:14.503941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:14.517766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eea80-a410-464a-9410-85d68c10c87b service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:14.524478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:14.524601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:14.524850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:14.525409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:14.534977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:14.536568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:14.556078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1094/2176] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:20.755741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd80e-c9aa-484a-b68a-654cf181fc4e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:20.756313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd80e-c9aa-484a-b68a-654cf181fc4e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:20.756313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd80e-c9aa-484a-b68a-654cf181fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:20.776242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-981dd80e-c9aa-484a-b68a-654cf181fc4e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:20.777408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-981dd80e-c9aa-484a-b68a-654cf181fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:20.785751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1083/2177] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:20.810296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:20.822090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a23318-7837-4027-a7bb-c92e533c58ee service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:20.828104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:20.829201 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:20.833012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:20.833012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:20.839071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:20.840675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc64b0e-38a5-4f8c-b4d2-acd8263537c2 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:20.850556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1095/2178] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:20.980420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:20.982120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:20.982120 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:20.982617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1084/2179] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:20.988697 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd503-7307-417c-a4cc-0e03d0191b09 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:20.989050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd503-7307-417c-a4cc-0e03d0191b09 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:20.989488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd503-7307-417c-a4cc-0e03d0191b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.009919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-649fd503-7307-417c-a4cc-0e03d0191b09 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:21.011136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-649fd503-7307-417c-a4cc-0e03d0191b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:21.021613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1096/2180] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:21.032797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:21.034859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:21.093506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4af67-3205-4da0-85d6-677ad82f4cd6 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:21.097029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:21.097624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.097930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.098200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.108146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:21.110418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e33877-468d-41eb-ab7d-3143dab149d8 service glance] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:21.120833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1085/2181] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:21.363844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289cc4-7de5-42e0-88d6-4ffc6e3b9a24 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.364154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289cc4-7de5-42e0-88d6-4ffc6e3b9a24 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.364291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b289cc4-7de5-42e0-88d6-4ffc6e3b9a24 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.365622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1097/2182] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:21.370382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6801d-99b1-4b4b-b08f-e2aa65da2fc6 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.370669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6801d-99b1-4b4b-b08f-e2aa65da2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.370943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6801d-99b1-4b4b-b08f-e2aa65da2fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.391649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-84f6801d-99b1-4b4b-b08f-e2aa65da2fc6 None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:21.392913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-84f6801d-99b1-4b4b-b08f-e2aa65da2fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:21.402961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1086/2183] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:21.415581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b289cc4-7de5-42e0-88d6-4ffc6e3b9a24 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:21.427822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b289cc4-7de5-42e0-88d6-4ffc6e3b9a24 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:21.431414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:21.432133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.432409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.432680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.440712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:21.442335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0563e-b03f-4677-8542-2de1df242742 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:21.451169 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1098/2184] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:21.543843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.544127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.544439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.545838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1087/2185] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:25:21.551837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d404-93fa-4548-95c5-bfae06c62282 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.552174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d404-93fa-4548-95c5-bfae06c62282 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.552452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d404-93fa-4548-95c5-bfae06c62282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.573392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-cd80d404-93fa-4548-95c5-bfae06c62282 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:21.574612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cd80d404-93fa-4548-95c5-bfae06c62282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:21.585331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1099/2186] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:25:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:21.599819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:21.601715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:21.624043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97eee6-3cd6-4f7f-9f07-f5873242ef08 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:21.626044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:21.626973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:21.627430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:21.627852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:21.645293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:21.647044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:21.660238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1088/2187] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:28.085115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4750fa-8baf-4c62-ac65-6cbca173e268 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:28.085680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4750fa-8baf-4c62-ac65-6cbca173e268 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:28.085680 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4750fa-8baf-4c62-ac65-6cbca173e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:28.123727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5c4750fa-8baf-4c62-ac65-6cbca173e268 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:28.123727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5c4750fa-8baf-4c62-ac65-6cbca173e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:28.123727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1100/2188] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:28.139636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:28.152981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e14d-920b-4638-ac5a-b92d006db0ce service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:28.159386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:28.160006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:28.160285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:28.160563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:28.169934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:28.171650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:28.200108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1089/2189] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:25:35.433710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316f49-85ac-4871-bb43-0327b95dd94d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:35.434369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316f49-85ac-4871-bb43-0327b95dd94d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:35.434369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47316f49-85ac-4871-bb43-0327b95dd94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:35.456791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-47316f49-85ac-4871-bb43-0327b95dd94d None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:25:35.458407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-47316f49-85ac-4871-bb43-0327b95dd94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:25:35.466554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1101/2190] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:25:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:25:35.481270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:25:35.494124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12130cb1-2178-4804-b966-a3d9fef90809 service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:25:35.499665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:25:35.505502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:25:35.505502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:25:35.505502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:25:35.515861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:25:35.518927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:25:35.531381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1090/2191] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:25:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:25:45.450503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=60 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:45.524717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=56 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:02.358867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d054d7-2b5b-45ad-bb42-037343b2699c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:02.359438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d054d7-2b5b-45ad-bb42-037343b2699c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:02.359541 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d054d7-2b5b-45ad-bb42-037343b2699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:02.380605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-88d054d7-2b5b-45ad-bb42-037343b2699c None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:02.381805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-88d054d7-2b5b-45ad-bb42-037343b2699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:02.389024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1102/2192] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:26:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:02.414297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:02.426847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed020-74de-489f-98a8-f7cfde01fb49 service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:02.432838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:02.433456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:02.433722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:02.434136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:02.443723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:02.445404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:02.457946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1091/2193] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:09.274682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb7d7-08f9-41d9-bb68-15c513179f46 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:09.275604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb7d7-08f9-41d9-bb68-15c513179f46 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:09.276051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efb7d7-08f9-41d9-bb68-15c513179f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:09.299716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-96efb7d7-08f9-41d9-bb68-15c513179f46 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:09.303207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-96efb7d7-08f9-41d9-bb68-15c513179f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:09.315507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1103/2194] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:26:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:09.357330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:09.374172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443378f-f6ef-43e6-a8b1-bf6bf07622af service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:09.381070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:09.381752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:09.382114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:09.382412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:09.395381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:09.396968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38f93-b225-4510-8773-cdb321b6e5b2 service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:09.411208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1092/2195] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:26:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:16.466917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:16.467470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:16.467470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:16.488190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] MFA Rules not processed for user `b811b21e6dc14049818fecf83dca683b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:16.489489 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:16.563189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1104/2196] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:19.411014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=12 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:20.945911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:20.946834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:20.947110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:20.968383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:20.969640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:20.977277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1093/2197] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:26:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:20.992737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:21.006842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26919bd-624b-4a19-be0f-fa15e7ca41c1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:21.014423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:21.015191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:21.015573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:21.015912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:21.025178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:21.026939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:21.035813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1105/2198] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:24.274199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:24.279043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:24.292525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576617c-0b12-44a3-b056-4de7eb914734 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:24.297940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:24.298755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:24.299035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:24.299313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] PATH_INFO: `/v3/users/5a831d148b144eeaa3fa1c402f6f59e6` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:24.300520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a831d148b144eeaa3fa1c402f6f59e6)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:24.302469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:24.466617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a831d148b144eeaa3fa1c402f6f59e6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:24.517264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a831d148b144eeaa3fa1c402f6f59e6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:24.518280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a831d148b144eeaa3fa1c402f6f59e6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:24.519037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a831d148b144eeaa3fa1c402f6f59e6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:24.527346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a831d148b144eeaa3fa1c402f6f59e6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:24.546051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1094/2199] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:26:24 2022] DELETE /identity/v3/users/5a831d148b144eeaa3fa1c402f6f59e6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:26:24.919705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:24.935417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74605-fe64-41e5-95f6-9d2ec35c3f07 service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:24.994204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:24.994851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:24.995133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:24.995411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] PATH_INFO: `/v3/projects/f6bc4d79724747a68f05f68e3b48c719` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:24.996535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bc4d79724747a68f05f68e3b48c719)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:24.998513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:25.111610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bc4d79724747a68f05f68e3b48c719', 'request_id': 'req-c206574c-1338-4045-a49c-3eb5d7dad163'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:25.118018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bc4d79724747a68f05f68e3b48c719', 'request_id': 'req-c206574c-1338-4045-a49c-3eb5d7dad163'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:25.197658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bc4d79724747a68f05f68e3b48c719', 'request_id': 'req-c206574c-1338-4045-a49c-3eb5d7dad163'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:25.210123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] The token cache is being invalidate because project f6bc4d79724747a68f05f68e3b48c719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:26:25.210418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:25.211154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:26:25.212688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1106/2200] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:26:24 2022] DELETE /identity/v3/projects/f6bc4d79724747a68f05f68e3b48c719 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:26:32.798621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:32.800099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:32.856867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f312e-677a-41d9-bca6-14f3071e6063 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:32.910566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:32.911169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:32.911441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:32.911712 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:32.913411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:32.924523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:32.926020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:32.933985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:32.939236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206574c-1338-4045-a49c-3eb5d7dad163 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:32.943711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:32.948305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:32.948305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:32.948305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:32.948305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:32.951298 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:32.994787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:32.996344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51d4fb-62ab-4ebd-a2cc-1df9dafbc9fb service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:33.009773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1095/2201] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:33.029464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:33.031135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a356ffa-a4eb-4f66-9e0b-67cfd186ecb7 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:33.051953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1107/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:26:35.571742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:35.572319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:35.572319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:35.592588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] MFA Rules not processed for user `0705d79d87ee4adc913a4266c2f3139b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:35.593797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:35.650258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1096/2203] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:43.063004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=33 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:45.108452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efecc3-4a5c-4d60-824a-e463dc52372a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:45.109160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efecc3-4a5c-4d60-824a-e463dc52372a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:45.109160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32efecc3-4a5c-4d60-824a-e463dc52372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:45.139984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-32efecc3-4a5c-4d60-824a-e463dc52372a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:45.141207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-32efecc3-4a5c-4d60-824a-e463dc52372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:45.236652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1108/2204] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:45.273813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:45.275973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:45.300540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2b7c8-b3d6-4008-ae7f-baf0149cbca9 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:45.308059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:45.308829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:45.309165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:45.309372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:45.321178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:45.322881 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:45.334428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1097/2205] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:26:50.636389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f87c-63c7-4a43-b179-3f42375e5e5e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:50.637157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f87c-63c7-4a43-b179-3f42375e5e5e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:50.637157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f87c-63c7-4a43-b179-3f42375e5e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:50.657613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d277f87c-63c7-4a43-b179-3f42375e5e5e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:50.658889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d277f87c-63c7-4a43-b179-3f42375e5e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:50.667786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1109/2206] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:50.690901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:50.703258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51228d-6ea1-4fe6-8f7a-1bf3e9816590 service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:50.709428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:50.710254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:50.710548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:50.710818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:50.719858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:50.721456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:50.732104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1098/2207] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:54.486126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:54.486667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:54.486667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:54.507386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:54.508708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:54.520419 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1110/2208] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:26:54.547243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:54.548699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:54.563630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37370b-d34e-46d0-83e4-64c023d47e6c service nova] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:54.569105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:54.569897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:54.570191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:54.570464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:54.578791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:54.580364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e049d98-335d-4d49-9da8-cac9ed935741 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:54.590502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1099/2209] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:58.682763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:58.696525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49e03a-bef3-4918-abde-6611e9feea1d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:58.702179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:58.702792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:58.703074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:58.703346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:58.705358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:58.778778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:58.780390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:58.790976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1111/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:26:58.802910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723710e-e494-422e-960b-993e1307ac86 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:58.803428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723710e-e494-422e-960b-993e1307ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:58.803542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723710e-e494-422e-960b-993e1307ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:58.824644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c723710e-e494-422e-960b-993e1307ac86 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:26:58.825848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c723710e-e494-422e-960b-993e1307ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:26:58.834433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1100/2211] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:26:58.869708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:26:58.881270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94c7fe-114e-46e8-924c-f5773a007841 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:26:58.886939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:26:58.887607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:26:58.887889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:26:58.888158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:26:58.897643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:26:58.899428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:26:58.910147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1112/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:05.171616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:05.172585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:05.172854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:05.184813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=64 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:05.197655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:05.199146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:05.208448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1101/2213] 10.222.0.45 () {58 vars in 1016 bytes} [Wed Aug 17 20:27:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:05.233574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:05.253709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747c1af-369c-436c-945d-58f0712df19b service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:05.265970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:05.267246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:05.268043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:05.269146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:05.290251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:05.294020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:05.310656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1113/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:15.222047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:15.303446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=73 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:20.133140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:20.147519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20dcf-3c55-4a69-9d86-896f595e00d1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:20.154522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:20.155143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.155418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.155685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.157730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:20.245264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:20.247037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3fc89-416c-4243-a777-5700198942a4 service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:20.258549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1102/2215] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:20.606409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:20.621120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2de8-236a-4b1f-ac3f-28c01268110c service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:20.630511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:20.631138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:20.631420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:20.631694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:20.634627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:20.648714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:20.651313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:20.667007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1114/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:27.907095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:27.907643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:27.907643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:27.931069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] MFA Rules not processed for user `46b27047a70c437e8ff046a02a0db8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:27.932716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:27.940710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1103/2217] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:27:28.605543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:28.615735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472886fc-a215-4d62-8f2c-8d91d2acbe48 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:28.621938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:28.623311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:28.623311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:28.623828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:28.627060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:28.646035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:28.649037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b2062-5345-41fd-a8eb-55973a563c92 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:28.666275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1115/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:29.241927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:29.242616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:29.392176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a695e-5e16-45ac-b178-440fadbf0f0e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:29.397869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672945-913c-452f-9124-9769d274c088 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:29.398627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672945-913c-452f-9124-9769d274c088 service placement] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:29.398998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672945-913c-452f-9124-9769d274c088 service placement] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:29.400005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf672945-913c-452f-9124-9769d274c088 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:29.402467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bf672945-913c-452f-9124-9769d274c088 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:29.416391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf672945-913c-452f-9124-9769d274c088 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:29.418023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf672945-913c-452f-9124-9769d274c088 service placement] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:29.429453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1104/2219] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:27:33.178244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:33.178785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:33.178929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:33.202628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] MFA Rules not processed for user `2e9acd97be994f3ca7e36732f28470c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:33.203864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:33.211177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1116/2220] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:33.638509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672945-913c-452f-9124-9769d274c088 service placement] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:33.640232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bf672945-913c-452f-9124-9769d274c088 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:33.656107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf672945-913c-452f-9124-9769d274c088 service placement] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:33.660438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:33.661046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:33.661321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:33.661588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:33.663457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:33.678646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:33.680625 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:33.692656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1105/2221] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:42.400049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:42.416458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa6764-2cca-4ba6-8afd-71adf3860180 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:42.422066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:42.422678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:42.422957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:42.423229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:42.425090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:42.439475 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:42.441139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:42.452909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1117/2222] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:43.686759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=69 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:48.412662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:48.426349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150ff5d-f547-4d4e-8c5c-07ace843070e service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:48.431779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:48.432538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:48.432916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:48.433316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:48.435622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:48.452519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:48.454677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:48.468352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1106/2223] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:27:48.613443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:48.614524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:48.624669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=22 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:48.638033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de49442-348e-4444-ad03-ffc7a335d302 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:48.650575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:48.665094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:48.665094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:48.665094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] PATH_INFO: `/v3/users/b811b21e6dc14049818fecf83dca683b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:48.665094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b811b21e6dc14049818fecf83dca683b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:48.665094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:48.920748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b811b21e6dc14049818fecf83dca683b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:48.999852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b811b21e6dc14049818fecf83dca683b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.004586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b811b21e6dc14049818fecf83dca683b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.004586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b811b21e6dc14049818fecf83dca683b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.014285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b811b21e6dc14049818fecf83dca683b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.047193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1118/2224] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:48 2022] DELETE /identity/v3/users/b811b21e6dc14049818fecf83dca683b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:49.463857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:49.477759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154d526-4b40-4ad9-96b1-377d92a1c746 service placement] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:49.529025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:49.531931 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:49.593478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:49.594249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:49.594590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:49.594924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:49.596861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:49.610912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:49.612827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07834880-d5da-4fe6-8677-0f681a9aae6c service nova] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:49.630219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1107/2225] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:49.632238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21a15-eb75-4694-a5ee-0cc2855c1ac5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:49.638000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:49.638906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:49.639410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:49.639683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] PATH_INFO: `/v3/projects/b216c6987b174378bde93963dcd0297b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:49.641009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b216c6987b174378bde93963dcd0297b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:49.643208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:49.778285 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b216c6987b174378bde93963dcd0297b', 'request_id': 'req-da901dd7-5162-4063-af3b-0ecebd24d373'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.785172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b216c6987b174378bde93963dcd0297b', 'request_id': 'req-da901dd7-5162-4063-af3b-0ecebd24d373'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.878303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b216c6987b174378bde93963dcd0297b', 'request_id': 'req-da901dd7-5162-4063-af3b-0ecebd24d373'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.894111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] The token cache is being invalidate because project b216c6987b174378bde93963dcd0297b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:49.894543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.895356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-da901dd7-5162-4063-af3b-0ecebd24d373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:49.897060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1119/2226] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:49 2022] DELETE /identity/v3/projects/b216c6987b174378bde93963dcd0297b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:49.902266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:49.902839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:49.903290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:49.928194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:49.929458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:50.019427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1108/2227] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:50.026868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.027695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.027898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.038248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:50.050893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:50.052140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:50.062521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1120/2228] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:50.065366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.076411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a74a0-8d9e-4571-85cb-0081c4ac0fc1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.085453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.086304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.086680 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.087057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.087846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:27:50.088255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.090293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.104274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1109/2229] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:27:50.118847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.129593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ea70-7aff-464f-bbdb-a87f71fa04cd None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.134520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.135154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.135438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.135712 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.136530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.139883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.415581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1121/2230] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:27:50 2022] POST /identity/v3/projects => generated 399 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:27:50.421335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.433610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea698140-faef-48d3-96b9-b5ae7269edd4 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.512974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.513624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.513862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.514340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.515167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.517545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.527953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:50.594847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1110/2231] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:27:50 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:27:50.599140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.614622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a78c6-7160-4bec-834a-09bf25c5860f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.617034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.617662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.617984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.618264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.618924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.620635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.635259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1122/2232] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:27:50.651978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.663496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f817da-ffa3-4bf6-b827-fe4b3ded0619 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.668421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.669094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.669443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.669862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.670630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.672333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca54ef-341e-4ab5-a43d-38c7cb00637e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.687329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1111/2233] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:27:50.701137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.711861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e028-3e02-42b9-8aef-a31aec68330b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:50.718284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:50.719209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.719865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.720403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] PATH_INFO: `/v3/projects/14eb798a7bf3490db5323e479184b39e/users/b2db9d0d7cc14e89837416a78d1bcfda/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.740822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eb798a7bf3490db5323e479184b39e, user_id=b2db9d0d7cc14e89837416a78d1bcfda, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:50.743565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:50.847222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1123/2234] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:27:50 2022] PUT /identity/v3/projects/14eb798a7bf3490db5323e479184b39e/users/b2db9d0d7cc14e89837416a78d1bcfda/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:50.858218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:50.858617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:50.858795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:50.892577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] MFA Rules not processed for user `b2db9d0d7cc14e89837416a78d1bcfda`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:50.893074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:50.963869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1112/2235] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:50 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:50.975582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:50.977311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:51.050926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3143-e167-4e09-84ef-ae17c7359c94 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:51.056855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:51.057137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:51.057422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:51.057739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:51.069257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:51.070761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:51.083395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1124/2236] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:50 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:27:51.207900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:51.228277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ad661-d1b4-4043-bd8f-c44900cfba7e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:51.233369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:51.234184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:51.234661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:51.235004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:51.236994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:51.337180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:51.338805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49740-dc95-4a77-98df-b640892f77ed service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:51.349368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1113/2237] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:27:58.552434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:58.627250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08e768-b60c-4de1-a343-f421d4452b84 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:58.632255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:58.632970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:58.633292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:58.633768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] PATH_INFO: `/v3/users/b2db9d0d7cc14e89837416a78d1bcfda` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:58.635443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2db9d0d7cc14e89837416a78d1bcfda)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:58.637734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:58.840689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:58.842575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2db9d0d7cc14e89837416a78d1bcfda'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:58.917258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2db9d0d7cc14e89837416a78d1bcfda'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:58.917974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2db9d0d7cc14e89837416a78d1bcfda'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:58.918527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2db9d0d7cc14e89837416a78d1bcfda'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:58.926765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2db9d0d7cc14e89837416a78d1bcfda'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:58.945832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1125/2238] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:27:58 2022] DELETE /identity/v3/users/b2db9d0d7cc14e89837416a78d1bcfda => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:58.950438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:58.950930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:58.951205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:58.972835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:58.974140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:59.047960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:59.058929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:59.060866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:59.123617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244bbf3-7229-49ca-998b-de12ac002073 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:59.127394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:59.128029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:59.128439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:59.128720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:59.138868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:59.140352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b7a9c-145d-437d-8781-79419986ef97 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:59.152133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1126/2240] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:27:59.580946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:59.582554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:59.596279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6a17-a365-4444-bbd5-862ff52e270d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:27:59.601649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:27:59.602423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:59.602533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:59.602846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] PATH_INFO: `/v3/projects/14eb798a7bf3490db5323e479184b39e` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:59.604149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eb798a7bf3490db5323e479184b39e)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:27:59.606130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:27:59.608122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:59.730318 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eb798a7bf3490db5323e479184b39e', 'request_id': 'req-c38d3151-16f0-4691-8a30-f5dc8b8102ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:59.738408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eb798a7bf3490db5323e479184b39e', 'request_id': 'req-c38d3151-16f0-4691-8a30-f5dc8b8102ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:59.838721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eb798a7bf3490db5323e479184b39e', 'request_id': 'req-c38d3151-16f0-4691-8a30-f5dc8b8102ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:59.850527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] The token cache is being invalidate because project 14eb798a7bf3490db5323e479184b39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:27:59.850821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:59.851500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-c38d3151-16f0-4691-8a30-f5dc8b8102ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:27:59.853026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1115/2241] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:27:59 2022] DELETE /identity/v3/projects/14eb798a7bf3490db5323e479184b39e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:27:59.858491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:59.861137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:59.861137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:59.879151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:59.880390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:59.942295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1127/2242] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:59.950099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:27:59.950384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:27:59.951300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:27:59.971616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:27:59.972826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:27:59.982004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1116/2243] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:27:59.986291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:27:59.996156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8b071-56be-413b-8b95-e28d62b83206 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.001699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.002349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.002640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.002936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.003598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:00.003896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.005499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.018543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:00.023000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.033030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b2de2-3181-4969-81a0-662ebf2e9652 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.038055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.038589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.038981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.039266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.039913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.041857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.150289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1117/2245] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:00 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:00.156560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.169439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d44c32-abc0-4a1b-953a-ee59e8318784 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.224612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:00.234652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.235364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.235640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.235908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.236669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.238687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.388515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1129/2246] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:00 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:00.392974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.403575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3649-1f97-40a0-b0d9-9fc2e7926b8b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.409194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.409845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.410153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.410423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.411067 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.412681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.423738 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1118/2247] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:00.429870 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.442624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22708a-ff48-472f-9b77-6c8f03fae222 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.447685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.448288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.448570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.448978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.449636 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.452305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555bacb-6701-4a99-8752-6a11ef7ac7c4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.463420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1130/2248] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:00.467805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.478782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862f11-afe2-4f95-8401-8051ebf04522 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.484140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.484836 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.485115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.485387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] PATH_INFO: `/v3/projects/498b5991a58f4b7e92d97d466e764950/users/facbc1ded061421fa287f04ad83de24f/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.502493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=498b5991a58f4b7e92d97d466e764950, user_id=facbc1ded061421fa287f04ad83de24f, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.505191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.641590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1119/2249] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:00 2022] PUT /identity/v3/projects/498b5991a58f4b7e92d97d466e764950/users/facbc1ded061421fa287f04ad83de24f/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:00.647208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af27e2-b4ea-45c0-a906-666920bff402 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.647572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af27e2-b4ea-45c0-a906-666920bff402 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.647811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af27e2-b4ea-45c0-a906-666920bff402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.669142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-30af27e2-b4ea-45c0-a906-666920bff402 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:00.670530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-30af27e2-b4ea-45c0-a906-666920bff402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:00.740888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1131/2250] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:00.752039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:00.754140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:00.819698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399232f-c516-48b5-b4c3-8fb5ece9f6ff admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:00.825228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:00.826092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:00.826429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:00.829084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:00.837616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:00.839162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:00.849971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1120/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:08.664886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:08.665468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:08.665468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:08.698392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] MFA Rules not processed for user `facbc1ded061421fa287f04ad83de24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:08.699667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:08.770861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1132/2252] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:08.775378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:08.786080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32297c5-75a2-4e02-9507-589b5e2b8274 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:08.790923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:08.791560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:08.791862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:08.792309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:08.793101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:08.796084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:08.929213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1121/2253] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:08 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:08.935747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:08.949819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d506af-2b25-40b3-8083-1f3142f66e58 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:09.048919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:09.049447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:09.049733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:09.050199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:09.050733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:09.052684 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:09.072565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:09.190322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1133/2254] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:08 2022] POST /identity/v3/users => generated 298 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:09.194537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:09.207138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621f394-794e-4094-9d7b-235f12a85288 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:09.213807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:09.218754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:09.218754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:09.218754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:09.218754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:09.218754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:09.222453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:09.233286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1122/2255] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:09.237784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:09.264358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa074cd-3c06-4575-b7dd-f3cb2d733ae4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:09.277095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:09.278642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:09.279049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:09.279333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] PATH_INFO: `/v3/projects/9bb901d58f164b909071a96289a97b01/users/480384fc52cc4b2eb01531a08dc85ed0/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:09.307290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb901d58f164b909071a96289a97b01, user_id=480384fc52cc4b2eb01531a08dc85ed0, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:09.319026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:09.521932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1134/2256] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:09 2022] PUT /identity/v3/projects/9bb901d58f164b909071a96289a97b01/users/480384fc52cc4b2eb01531a08dc85ed0/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:09.532815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:09.537962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5665eb-03d4-4656-b9b6-d4982f5704c4 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:09.606857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:09.608328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:09.608904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:09.609245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:09.610231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:09.612054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b480c45-dd76-45b6-90e8-7ac949b2bf14 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:09.624830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1123/2257] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:09.629190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:09.641030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f53d1-8e74-4312-b5b7-cfc2c3fa90f3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:09.646130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:09.646910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:09.647252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:09.647611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] PATH_INFO: `/v3/projects/9bb901d58f164b909071a96289a97b01/users/480384fc52cc4b2eb01531a08dc85ed0/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:09.649679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb901d58f164b909071a96289a97b01, user_id=480384fc52cc4b2eb01531a08dc85ed0, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:09.653112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:09.674224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1135/2258] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:09 2022] PUT /identity/v3/projects/9bb901d58f164b909071a96289a97b01/users/480384fc52cc4b2eb01531a08dc85ed0/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:16.900684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052cab-69cf-4a4a-bab2-fd12083cf298 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:16.901587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052cab-69cf-4a4a-bab2-fd12083cf298 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:16.901859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24052cab-69cf-4a4a-bab2-fd12083cf298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:16.939380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-24052cab-69cf-4a4a-bab2-fd12083cf298 None None] MFA Rules not processed for user `480384fc52cc4b2eb01531a08dc85ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:16.941940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-24052cab-69cf-4a4a-bab2-fd12083cf298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:17.063855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1124/2259] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:17.076961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:17.083055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:17.163457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8586d-4149-4c77-bae7-ec0d1e838ce3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:17.167375 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:17.168048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:17.168330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:17.168596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:17.249240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:17.250685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:17.265912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1136/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:28:17.582635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:17.582922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:17.583199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:17.604200 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:17.605432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:17.692938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1125/2261] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:28:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:17.872630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:17.874238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:17.956834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74f13a-1dce-49b6-b290-de3fa9dfd829 service glance] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:17.962005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:17.962913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:17.963199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:17.963465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:17.973162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:17.974788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:17.978485 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:17.984518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1137/2262] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:28:23.582152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:23.622024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:23.669688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb474c-85bc-4604-9445-55932732e4e1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:23.676384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:23.677578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:23.678021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:23.678683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:23.681383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:23.778134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:23.780996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:23.804930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1126/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:28.081360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:29.103372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:29.106196 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:29.188173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be2301-e66a-41c4-b07d-26df2e97114c service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:29.193539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:29.194215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:29.194499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:29.194765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:29.196565 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:29.209318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:29.210967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f104dc-a3a9-4066-84c4-0fbe63c30867 service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:29.224967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1138/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:29.278482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:29.281551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:29.302833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524b48d-4051-4198-89eb-e1ba27453105 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:29.308240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:29.308950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:29.309228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:29.309553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] PATH_INFO: `/v3/users/0705d79d87ee4adc913a4266c2f3139b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:29.310935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0705d79d87ee4adc913a4266c2f3139b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:29.313986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:29.382365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:29.382365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:29.382365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:29.403180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] MFA Rules not processed for user `facbc1ded061421fa287f04ad83de24f`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:29.404319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:29.412100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1139/2265] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:29.536659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0705d79d87ee4adc913a4266c2f3139b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:29.604404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0705d79d87ee4adc913a4266c2f3139b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:29.605202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0705d79d87ee4adc913a4266c2f3139b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:29.605898 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0705d79d87ee4adc913a4266c2f3139b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:29.615432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2c51600a-dd1b-42ec-b816-30ba9fec29ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0705d79d87ee4adc913a4266c2f3139b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:29.640035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1127/2266] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:29 2022] DELETE /identity/v3/users/0705d79d87ee4adc913a4266c2f3139b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:29.953224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:29.976182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e5627-eb20-4c02-8fd3-30535281aba5 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:30.042813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:30.043547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.043823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.044124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] PATH_INFO: `/v3/projects/27dbbd158d484fb98a2bf71e65a9a6ea` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.045833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=27dbbd158d484fb98a2bf71e65a9a6ea)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:30.052751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:30.195037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27dbbd158d484fb98a2bf71e65a9a6ea', 'request_id': 'req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:30.208887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27dbbd158d484fb98a2bf71e65a9a6ea', 'request_id': 'req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:30.331605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27dbbd158d484fb98a2bf71e65a9a6ea', 'request_id': 'req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:30.346238 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] The token cache is being invalidate because project 27dbbd158d484fb98a2bf71e65a9a6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:30.346532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:30.347280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bfc57921-46a1-4d5a-bec8-bd5eaa158a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:30.348781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1140/2267] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:29 2022] DELETE /identity/v3/projects/27dbbd158d484fb98a2bf71e65a9a6ea => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:30.353925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.354433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.354433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.375149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:30.376363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:30.418187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:30.439511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1128/2268] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:30.447583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.447789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.448062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.470550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:30.472168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:30.480647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1141/2269] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:30.490163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:30.500878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c62c-dc06-4fd5-b8a8-74b7f02e316a None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:30.505691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:30.506337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.506633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.506901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.507583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:30.507889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:30.509538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:30.523230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1129/2270] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:30.534300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:30.544411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022cab1-a407-40b8-ba8b-69db822fb6ba None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:30.550142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:30.550801 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.551084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.551425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.552039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:30.554341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:30.559977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:30.688690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1142/2271] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:30 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:30.693501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:30.710918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c852e6-d802-4b7a-a8ff-b6824cb3d116 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:30.808006 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:30.809049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:30.809536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:30.810061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:30.811777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:30.815704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:30.978345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1130/2272] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:30 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:30.982413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:30.994446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d62b90-0700-48b9-87c9-d44fda5d1266 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:30.999747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:31.000785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:31.001344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:31.002249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:31.003091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:31.004849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:31.020418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1143/2273] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:31.026244 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:31.038779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09a58-986b-4afd-8f50-508fa8fc91e3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:31.043797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:31.044590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:31.044823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:31.045105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:31.046410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:31.048054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570be62-9bcc-4fef-bf12-af31b5413974 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:31.060520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1131/2274] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:31.065187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:31.077577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddcdf8-7cbb-4e00-8363-5865e45001d6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:31.090822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:31.092935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:31.093465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:31.094241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] PATH_INFO: `/v3/projects/c57329f853c64520b5cef546ee2de2f3/users/e205f0010f6f418d8a77b9f483894f00/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:31.122637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57329f853c64520b5cef546ee2de2f3, user_id=e205f0010f6f418d8a77b9f483894f00, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:31.125860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:31.254703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1144/2275] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:31 2022] PUT /identity/v3/projects/c57329f853c64520b5cef546ee2de2f3/users/e205f0010f6f418d8a77b9f483894f00/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:31.274732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70b2d-8462-470d-9ab6-496e92d092fa None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:31.275177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70b2d-8462-470d-9ab6-496e92d092fa None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:31.275522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70b2d-8462-470d-9ab6-496e92d092fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:31.333460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-dae70b2d-8462-470d-9ab6-496e92d092fa None None] MFA Rules not processed for user `e205f0010f6f418d8a77b9f483894f00`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:31.334758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-dae70b2d-8462-470d-9ab6-496e92d092fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:31.401804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1132/2276] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:31.414695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:31.416594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:31.498290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4b6a-ace3-44c9-87a2-9f2c81d73d00 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:31.504309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:31.504934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:31.505214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:31.512756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:31.515457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:31.517081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:31.527054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1145/2277] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:33.653998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:33.655076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:33.655503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:33.677192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:33.678926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:33.725357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:33.751885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1133/2278] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:28:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:33.765604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:33.766843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:33.853839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e629d6-3137-4da6-97f4-f0adaf0eeb72 service nova] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:33.860259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:33.860890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:33.861295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:33.861727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:33.871092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:33.872848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862b40-651c-4785-b9ae-210a9590355b service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:33.884210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1146/2279] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:28:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:38.150457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.245443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7754f57-23cd-4818-ab45-2196b15b4802 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.256827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.258591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.259185 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.259784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] PATH_INFO: `/v3/users/e205f0010f6f418d8a77b9f483894f00` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.267238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e205f0010f6f418d8a77b9f483894f00)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.270866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.513312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e205f0010f6f418d8a77b9f483894f00'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:38.579258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e205f0010f6f418d8a77b9f483894f00'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:38.579904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e205f0010f6f418d8a77b9f483894f00'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:38.580612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e205f0010f6f418d8a77b9f483894f00'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:38.593129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e205f0010f6f418d8a77b9f483894f00'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:38.614395 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1134/2280] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:38 2022] DELETE /identity/v3/users/e205f0010f6f418d8a77b9f483894f00 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:38.619495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.620248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.620248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.646473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:38.647738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.682733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:38.743732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1147/2281] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:38.758792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:38.760352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:38.831902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e0d67-466d-4132-a9d3-2ed7e38eb3d0 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:38.836172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:38.836843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:38.837127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:38.837398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:38.850773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:38.852242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218ce44-e901-4942-aecb-9d441a7fa7df service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:38.864969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1135/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:39.438383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:39.441675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:39.460360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed77141-df10-48d9-af21-81dbe97bf6aa None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:39.466275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:39.466992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:39.467889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:39.468128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] PATH_INFO: `/v3/projects/c57329f853c64520b5cef546ee2de2f3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:39.469533 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57329f853c64520b5cef546ee2de2f3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:39.471739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:39.768759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57329f853c64520b5cef546ee2de2f3', 'request_id': 'req-57a2d08b-2513-4948-8b8f-d32eb9675d1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:39.780402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57329f853c64520b5cef546ee2de2f3', 'request_id': 'req-57a2d08b-2513-4948-8b8f-d32eb9675d1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:39.857202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57329f853c64520b5cef546ee2de2f3', 'request_id': 'req-57a2d08b-2513-4948-8b8f-d32eb9675d1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:39.880553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] The token cache is being invalidate because project c57329f853c64520b5cef546ee2de2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:39.881209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:39.882428 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-57a2d08b-2513-4948-8b8f-d32eb9675d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:39.885055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1148/2283] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:39 2022] DELETE /identity/v3/projects/c57329f853c64520b5cef546ee2de2f3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:28:39.890714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:39.891367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:39.891367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:39.906994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:39.916851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:39.920470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:40.050035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1136/2284] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:40.053621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.054229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.054645 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.077394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:40.079228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:40.087607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1149/2285] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:40.092385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.109110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab99c43-dafb-465b-a57f-5fdf85d6a460 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.120469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.121281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.121544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.121782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.122662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:40.123065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.125379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.142356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1137/2286] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:28:40.148293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.158716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa870d77-17d0-49da-9290-fbef8e33816d None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.163947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.164608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.164943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.165199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.165858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.168042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.294014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1150/2287] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:40 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:40.295206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.308044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e54f-7bb4-4afa-8141-88cc8eb59f7b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.429418 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.430528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.431020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.431523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.432683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.436568 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.534960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1138/2288] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:40 2022] POST /identity/v3/users => generated 284 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:40.541062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.562155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0887-856a-4a56-a146-56d465a4d345 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.570112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.571476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.571955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.572479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.573754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.578696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.598409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1151/2289] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:40.606772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.630606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbee59e-3af8-48a2-bf66-b4d3a4c145d8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.642939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.643751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.645242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.645830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.646731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.649202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e47b87-26c2-4b01-a6f2-b6443032eeb8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.665927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1139/2290] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:28:40.672955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:40.692998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23573d84-e3ef-4cfe-aee6-7a144a1ecd19 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:40.700155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:40.701440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.702312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.703076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] PATH_INFO: `/v3/projects/e12d0dbe7c8c41559b051b0774af8043/users/bc0b5bd02a244604b1562bb63742d298/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.746316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12d0dbe7c8c41559b051b0774af8043, user_id=bc0b5bd02a244604b1562bb63742d298, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:40.749965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:40.832537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1152/2291] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:40 2022] PUT /identity/v3/projects/e12d0dbe7c8c41559b051b0774af8043/users/bc0b5bd02a244604b1562bb63742d298/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:28:40.843939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:40.844236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:40.848571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:40.883855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] MFA Rules not processed for user `bc0b5bd02a244604b1562bb63742d298`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:40.885495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:41.016829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1140/2292] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:41.023144 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.096318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:41.119794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ae759-75df-4051-b9b2-6598be39e642 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.127290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.128360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.128822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.129309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.130562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.134608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.245107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1153/2293] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:41 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:41.250299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.261619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:41.269208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e115-54e0-4e62-9523-222797a5b1cb None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.354937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.356309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.356887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.357496 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.358746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.364962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.483169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1141/2294] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:41 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:41.488555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.508243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bd582-82d9-4aa2-a20d-a4b65c20197b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.515041 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.515674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.515957 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.516233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.516896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.518820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.531954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1154/2295] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:41.536443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.548700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e983-7313-44bd-bae1-12ad0d71622e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.554527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.555636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.556119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.556645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] PATH_INFO: `/v3/projects/05bd46beeec14ea1a92670a257119946/users/f6ef5f8dd8614ba5946daec28f93487a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.577632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd46beeec14ea1a92670a257119946, user_id=f6ef5f8dd8614ba5946daec28f93487a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.580776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.706615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1142/2296] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:41 2022] PUT /identity/v3/projects/05bd46beeec14ea1a92670a257119946/users/f6ef5f8dd8614ba5946daec28f93487a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:41.714171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.726943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334df6e5-3187-48db-90d4-9516f5abc6aa admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.819821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.820669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.821039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.821322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.822175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.824021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03301930-ec2e-44a4-93ce-71988b43f828 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.839627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1155/2297] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:41.846697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:41.864786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd457f9-288a-4847-b405-9db97e2a3f5a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:41.871547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:41.872735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.873214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.873903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] PATH_INFO: `/v3/projects/05bd46beeec14ea1a92670a257119946/users/f6ef5f8dd8614ba5946daec28f93487a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.878143 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bd46beeec14ea1a92670a257119946, user_id=f6ef5f8dd8614ba5946daec28f93487a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:41.892882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:41.909106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1143/2298] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:41 2022] PUT /identity/v3/projects/05bd46beeec14ea1a92670a257119946/users/f6ef5f8dd8614ba5946daec28f93487a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:41.919675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:41.922140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:41.922140 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:41.954698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] MFA Rules not processed for user `f6ef5f8dd8614ba5946daec28f93487a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:41.956335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:42.084050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1156/2299] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:42.098377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:42.100713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:42.215807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f016c07-28fb-43d7-a363-eb39c77a2d09 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:42.225322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:42.226701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:42.227037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:42.227448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:42.275526 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:42.277027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba62f8-8bb6-469f-929d-bac07755c175 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:42.305442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1144/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:28:47.258404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:47.338311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:47.375735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ebdc6-8a0a-4646-8d02-ed202683a277 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:47.381708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:47.382454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:47.382727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:47.382993 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] PATH_INFO: `/v3/users/bc0b5bd02a244604b1562bb63742d298` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:47.384160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0b5bd02a244604b1562bb63742d298)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:47.386186 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:47.576088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0b5bd02a244604b1562bb63742d298'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:47.676339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0b5bd02a244604b1562bb63742d298'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:47.677202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0b5bd02a244604b1562bb63742d298'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:47.678257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0b5bd02a244604b1562bb63742d298'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:47.689420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0b5bd02a244604b1562bb63742d298'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:47.716696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1157/2301] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:47 2022] DELETE /identity/v3/users/bc0b5bd02a244604b1562bb63742d298 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:47.721497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:47.722472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:47.722472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:47.745083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:47.746893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:47.817724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:47.827874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1145/2302] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:47.841587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:47.844398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:47.917328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014c50-edfc-4ec7-8016-7748b4877d37 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:47.922333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:47.922956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:47.923222 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:47.923467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:47.933747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:47.935190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:47.946634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1158/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:48.484379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:48.487689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:48.521106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300120b-f668-41d6-8f9e-d451ab1b232c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:48.528819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:48.529591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:48.530208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:48.530675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] PATH_INFO: `/v3/projects/e12d0dbe7c8c41559b051b0774af8043` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:48.533473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12d0dbe7c8c41559b051b0774af8043)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:48.540944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:48.707720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12d0dbe7c8c41559b051b0774af8043', 'request_id': 'req-4db14712-77fb-4321-896e-452b7595a3e7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:48.719134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12d0dbe7c8c41559b051b0774af8043', 'request_id': 'req-4db14712-77fb-4321-896e-452b7595a3e7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:48.830051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12d0dbe7c8c41559b051b0774af8043', 'request_id': 'req-4db14712-77fb-4321-896e-452b7595a3e7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:48.846087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] The token cache is being invalidate because project e12d0dbe7c8c41559b051b0774af8043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:48.846517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:48.847872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:48.850150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1146/2304] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:48 2022] DELETE /identity/v3/projects/e12d0dbe7c8c41559b051b0774af8043 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:48.854591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:48.869433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76026b97-e80f-446a-9016-8f473b511900 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:48.955086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:48.956206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:48.956686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:48.957154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] PATH_INFO: `/v3/users/f6ef5f8dd8614ba5946daec28f93487a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:48.959335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ef5f8dd8614ba5946daec28f93487a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:48.963334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:48.969212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:49.262625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ef5f8dd8614ba5946daec28f93487a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:49.368369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ef5f8dd8614ba5946daec28f93487a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:49.371278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ef5f8dd8614ba5946daec28f93487a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:49.372650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ef5f8dd8614ba5946daec28f93487a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:49.383800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0ccec755-ff80-430b-ae08-6776d323da96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ef5f8dd8614ba5946daec28f93487a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:49.418496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1159/2305] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:28:48 2022] DELETE /identity/v3/users/f6ef5f8dd8614ba5946daec28f93487a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:51.124691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:51.127017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:51.141618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db14712-77fb-4321-896e-452b7595a3e7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:51.202648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:51.203295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.203565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.203832 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] PATH_INFO: `/v3/projects/05bd46beeec14ea1a92670a257119946` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.205578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bd46beeec14ea1a92670a257119946)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:51.208048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:51.334502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bd46beeec14ea1a92670a257119946', 'request_id': 'req-d9f8f39b-5756-4548-ab04-8fc2f6447617'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:51.341944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bd46beeec14ea1a92670a257119946', 'request_id': 'req-d9f8f39b-5756-4548-ab04-8fc2f6447617'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:51.447122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bd46beeec14ea1a92670a257119946', 'request_id': 'req-d9f8f39b-5756-4548-ab04-8fc2f6447617'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:51.460779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] The token cache is being invalidate because project 05bd46beeec14ea1a92670a257119946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:28:51.464966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:51.464966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d9f8f39b-5756-4548-ab04-8fc2f6447617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:28:51.464966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1147/2306] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:28:51 2022] DELETE /identity/v3/projects/05bd46beeec14ea1a92670a257119946 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:51.470882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.471692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.471692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.492685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:51.494056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:51.564440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1160/2307] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:51.573032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.573448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.573773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.596084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:51.597233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:51.605551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1148/2308] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:51.611280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:51.621655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7de91-b060-43b5-b68c-0d9d1d91dd91 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:51.627460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:51.628085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.628365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.628635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.629299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:28:51.629664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:51.631341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:51.644539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1161/2309] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:28:51.650935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:51.657735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:51.661356 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9758-4cee-4fd2-b3e4-471af882103c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:51.666365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:51.671447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.671447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.671447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.671447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:51.671447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:51.762010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1149/2310] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:51 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:51.769142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:51.781026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ba3-fe05-4c88-a02a-cfa39087d7fc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:51.846584 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:51.847128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:51.847414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:51.847688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:51.848336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:51.850390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.082217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:52.194007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1162/2311] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:51 2022] POST /identity/v3/users => generated 288 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:52.195015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.195015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee914d-d926-44d4-ba4b-a7c1f18183d8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.195015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.195015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.196058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.196058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.196058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.196058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.196058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1150/2312] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:52.196628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.196628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446b31b-e7c0-439e-a3b8-659f70bddfa7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.196628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.196628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.196996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.196996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.196996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.196996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b10dd-f6b6-4ddd-80f2-8c7534d86c93 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.196996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1163/2313] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:52.197425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.197425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203fce-ee85-464c-9079-60310fdfc0b0 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.197425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.197425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.197798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.197798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] PATH_INFO: `/v3/projects/ddb0d54435334ab7a42c664d254fcf27/users/231fe45156634818a215c2594c2e93fa/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.205860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb0d54435334ab7a42c664d254fcf27, user_id=231fe45156634818a215c2594c2e93fa, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.208658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.316899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1151/2314] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:52 2022] PUT /identity/v3/projects/ddb0d54435334ab7a42c664d254fcf27/users/231fe45156634818a215c2594c2e93fa/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:52.328656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.328939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.329213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.359644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] MFA Rules not processed for user `231fe45156634818a215c2594c2e93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:52.360912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:52.429863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1164/2315] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:28:52.434280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.506093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e5ee-0207-4327-ad08-90ff3757155c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.511085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.511746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.512070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.512383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.513087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.515900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.627502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1152/2316] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:28:52 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:28:52.632470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.647899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4354bd-adda-484b-9843-ef908aeecad1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.717678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.719060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.719338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.719616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.720255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.722256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.836224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1165/2317] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:28:52 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:28:52.841171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.852084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eabcf6-0b3b-489d-b0fe-e3c345776e3e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.856934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.857544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.857819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.858216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.859095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.860741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:52.872607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1153/2318] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:52.878808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:52.893819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702262d-d82b-4136-8f4a-9ac3cc151bf5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:52.899713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:52.900400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:52.900686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:52.901068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] PATH_INFO: `/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d/users/eeb36ae40e4549e0b7ab35fac476aa9a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:52.918129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1a1136e08e458a824c2bf1a0d5406d, user_id=eeb36ae40e4549e0b7ab35fac476aa9a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:52.921081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:53.002669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1166/2319] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:52 2022] PUT /identity/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d/users/eeb36ae40e4549e0b7ab35fac476aa9a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:53.007317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:53.019225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33554979-f113-4aba-918a-e7e94babd753 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:53.080770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:53.081383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:53.081662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:53.081957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:53.082613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:53.084239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b266-282e-4ca7-9afd-8619f0a3b0a0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:53.095593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1154/2320] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:28:53.099885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:53.112374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5405d33-f0d5-46e9-8698-bd41587bf9ef admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:53.117347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:53.118097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:53.118379 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:53.118654 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] PATH_INFO: `/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d/users/eeb36ae40e4549e0b7ab35fac476aa9a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:53.120650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1a1136e08e458a824c2bf1a0d5406d, user_id=eeb36ae40e4549e0b7ab35fac476aa9a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:53.123416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:53.135397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1167/2321] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:28:53 2022] PUT /identity/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d/users/eeb36ae40e4549e0b7ab35fac476aa9a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:28:53.147434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:53.147721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:53.148003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:53.180828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] MFA Rules not processed for user `eeb36ae40e4549e0b7ab35fac476aa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:28:53.182104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:53.188281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:53.261581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1155/2322] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:28:53.273223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:53.275560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:53.341175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:53.396394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc53dd3-00b0-4797-9aba-9cba17f79bc5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:53.403385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:53.404170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:53.404652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:53.405725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:53.508197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:53.510555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:53.521941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1168/2323] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:28:58.090558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:28:58.092136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:28:58.105666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dca78-6214-440e-9b48-e235e00d9d2d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:28:58.110644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:28:58.111272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:28:58.111554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:28:58.111829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:28:58.122105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:28:58.123563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:28:58.134381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1156/2324] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:28:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:03.516879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=35 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:06.748585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:06.750377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:06.827210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3f83-3903-485b-b795-f5e6ea90d008 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:06.831333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:06.831875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:06.832156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:06.832430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:06.834343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:06.910058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:06.911543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:06.926949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1169/2325] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:29:08.129585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=32 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:13.388403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:13.399950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65362a-2d4b-4b87-a72a-4f2f6be95824 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:13.406696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:13.407735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:13.408187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:13.408622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:13.411394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:13.522378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:13.523797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44dd02e-f4db-41ba-91f7-24e0902551bc service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:13.539744 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1157/2326] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:15.399612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:15.462865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b86-aaf3-445c-99ce-6b6d35ab419e service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:15.467753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:15.468401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:15.468685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:15.468955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] PATH_INFO: `/v3/users/231fe45156634818a215c2594c2e93fa` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:15.470087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] RBAC: Authorizing `identity:delete_user(user_id=231fe45156634818a215c2594c2e93fa)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:15.472010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:15.648795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231fe45156634818a215c2594c2e93fa'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:15.653668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:15.744776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231fe45156634818a215c2594c2e93fa'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:15.745402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231fe45156634818a215c2594c2e93fa'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:15.746043 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231fe45156634818a215c2594c2e93fa'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:15.754165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231fe45156634818a215c2594c2e93fa'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:15.772749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1170/2327] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:15 2022] DELETE /identity/v3/users/231fe45156634818a215c2594c2e93fa => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:15.777311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:15.782193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:15.782193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:15.797406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:15.798659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:15.858516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1158/2328] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:15.868440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:15.870049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:15.933011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3bc18-96f3-4477-b816-e819256d147b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:15.938139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:15.938947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:15.939224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:15.939746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:15.949707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:15.951182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:15.962821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1171/2329] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:16.552728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:16.554519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:16.573175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7d6c0-5967-4131-8f68-263091d1b9b2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:16.578816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:16.579934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:16.579934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:16.580371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] PATH_INFO: `/v3/projects/ddb0d54435334ab7a42c664d254fcf27` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:16.581735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb0d54435334ab7a42c664d254fcf27)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:16.584405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:16.740760 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb0d54435334ab7a42c664d254fcf27', 'request_id': 'req-d8d12809-a862-4072-8599-41909db7f82b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:16.747757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb0d54435334ab7a42c664d254fcf27', 'request_id': 'req-d8d12809-a862-4072-8599-41909db7f82b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:16.853420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb0d54435334ab7a42c664d254fcf27', 'request_id': 'req-d8d12809-a862-4072-8599-41909db7f82b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:16.872635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] The token cache is being invalidate because project ddb0d54435334ab7a42c664d254fcf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:16.873198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:16.874118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:16.876511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1159/2330] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:16 2022] DELETE /identity/v3/projects/ddb0d54435334ab7a42c664d254fcf27 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:16.880864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:16.891181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060891e-3808-461f-85a3-406636a246f5 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:16.958513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:16.959170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:16.959448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:16.959721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] PATH_INFO: `/v3/users/eeb36ae40e4549e0b7ab35fac476aa9a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:16.960879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb36ae40e4549e0b7ab35fac476aa9a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:16.962880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:17.297503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb36ae40e4549e0b7ab35fac476aa9a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:17.378994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb36ae40e4549e0b7ab35fac476aa9a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:17.379721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb36ae40e4549e0b7ab35fac476aa9a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:17.380755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb36ae40e4549e0b7ab35fac476aa9a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:17.393424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ab744372-629e-4e7b-af0d-56f02d09adce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb36ae40e4549e0b7ab35fac476aa9a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:17.409617 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:17.431779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1172/2331] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:16 2022] DELETE /identity/v3/users/eeb36ae40e4549e0b7ab35fac476aa9a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:17.984536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:17.987831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:18.023063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d12809-a862-4072-8599-41909db7f82b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:18.047812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:18.098581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:18.099250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:18.099505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:18.099779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] PATH_INFO: `/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:18.100997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1a1136e08e458a824c2bf1a0d5406d)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:18.103664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:18.397277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1a1136e08e458a824c2bf1a0d5406d', 'request_id': 'req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:18.403918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1a1136e08e458a824c2bf1a0d5406d', 'request_id': 'req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:18.812678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1a1136e08e458a824c2bf1a0d5406d', 'request_id': 'req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:18.825199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] The token cache is being invalidate because project 8b1a1136e08e458a824c2bf1a0d5406d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:18.825492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:18.826212 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-ebb1fd6a-d5cc-467e-ab2e-8970082fffb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:18.828239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1160/2332] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:17 2022] DELETE /identity/v3/projects/8b1a1136e08e458a824c2bf1a0d5406d => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:18.834078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:18.834661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:18.834661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:18.855592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:18.856843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:18.924195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1173/2333] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:18.932683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:18.937814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:18.937814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:18.957423 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:18.958700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:18.968207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1161/2334] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:18.973236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:18.986832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7ff62-e0e2-44e8-a1d5-eea69e462e04 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:18.996947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:18.996947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:18.996947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:18.996947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:18.999132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:29:18.999132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:18.999132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.019996 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1174/2335] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:29:19.025262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.036127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1d46-b262-4433-90b4-8e8217989c36 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:19.042347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:19.043002 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.043286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.043978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.044218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:19.046193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.235108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1162/2336] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:19 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:19.239182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.257394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443480a-446b-4b53-af0d-fe442b7dc047 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:19.339495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:19.343442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.343442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.343442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.343442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:19.346442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.524128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1175/2337] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:19 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:29:19.528370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.542343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8f662-44eb-4512-bb39-376d7498a915 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:19.550092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:19.550714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.550988 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.551253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.551907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:19.553525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.579889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1163/2338] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:29:19.581859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.600856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d838cb-5b7d-45c4-9b11-0c13eb014d1a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:19.606553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:19.607284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.607665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.608010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.608811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:19.610629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5203b9b-eba2-4430-aa0a-be42bf7fda36 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.622649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1176/2339] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:19.628190 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.639465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069fd18-3cfd-4651-93b2-3dd9ebd1adbb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:19.647967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:19.648782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.650150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.650150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] PATH_INFO: `/v3/projects/0011052a423f474fbb79f52b04c64042/users/a9e9842f23074cdfac0b88fa4c048bfa/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.676189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0011052a423f474fbb79f52b04c64042, user_id=a9e9842f23074cdfac0b88fa4c048bfa, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:19.679185 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:19.784736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1164/2340] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:19 2022] PUT /identity/v3/projects/0011052a423f474fbb79f52b04c64042/users/a9e9842f23074cdfac0b88fa4c048bfa/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:19.797393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154017-63f6-4bba-9215-2b39f8e11ff7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:19.797393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154017-63f6-4bba-9215-2b39f8e11ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:19.797393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0154017-63f6-4bba-9215-2b39f8e11ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:19.833133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a0154017-63f6-4bba-9215-2b39f8e11ff7 None None] MFA Rules not processed for user `a9e9842f23074cdfac0b88fa4c048bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:19.834781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a0154017-63f6-4bba-9215-2b39f8e11ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:19.899087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:19.926785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1177/2341] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:19.942463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:19.945509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:20.023258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b352140-365c-41ce-99a1-f9f5eb4e9d38 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:20.026947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:20.027590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:20.027848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:20.028119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:20.037695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:20.039152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:20.049127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1165/2342] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:20.233906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:23.487737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c03a-fc62-4b32-b22a-782a2c5eb25f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:23.488235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c03a-fc62-4b32-b22a-782a2c5eb25f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:23.488339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c03a-fc62-4b32-b22a-782a2c5eb25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:23.521025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2327c03a-fc62-4b32-b22a-782a2c5eb25f None None] MFA Rules not processed for user `bbb975a644ea4e9b9582b8e4b06357b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:23.522483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2327c03a-fc62-4b32-b22a-782a2c5eb25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:23.615557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1178/2343] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:23.988430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:23.990127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:24.087142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdf99-9d4b-44a2-9f06-3c951dd0012c service glance] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:24.097793 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:24.104277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:24.104277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:24.104277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:24.104277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:24.117658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:24.119332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:24.135753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1166/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:33.614086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=43 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:34.128023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=39 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:42.354089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72965eb3-490f-45a7-b67a-fca6377f8957 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:42.354595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72965eb3-490f-45a7-b67a-fca6377f8957 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:42.355100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72965eb3-490f-45a7-b67a-fca6377f8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:42.376328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-72965eb3-490f-45a7-b67a-fca6377f8957 None None] MFA Rules not processed for user `46b27047a70c437e8ff046a02a0db8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:42.377623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-72965eb3-490f-45a7-b67a-fca6377f8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:42.448153 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1179/2345] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:43.318547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:43.471177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc34aad-680e-4a1e-a83f-16581aaa2ba5 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:43.479310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:43.480614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:43.482369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:43.482369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] PATH_INFO: `/v3/users/a9e9842f23074cdfac0b88fa4c048bfa` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:43.482960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e9842f23074cdfac0b88fa4c048bfa)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:43.485122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:43.849740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e9842f23074cdfac0b88fa4c048bfa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:43.967373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e9842f23074cdfac0b88fa4c048bfa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:43.968103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e9842f23074cdfac0b88fa4c048bfa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:43.968811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e9842f23074cdfac0b88fa4c048bfa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:43.982919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e9842f23074cdfac0b88fa4c048bfa'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:44.006704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1167/2346] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:43 2022] DELETE /identity/v3/users/a9e9842f23074cdfac0b88fa4c048bfa => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:44.011046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:44.011532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:44.011674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:44.059703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:44.060852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:44.130357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1180/2347] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:44.140155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:44.142620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:44.226152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:44.259125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb5d0e-9c70-43e4-b648-af88dcf6ffa7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:44.264676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:44.265567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:44.266954 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:44.268087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:44.283951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:44.287835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:44.318136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1168/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:29:44.886966 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:44.889433 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:44.913118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a521f39-15fe-45ac-93c2-b219b1aac5d1 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:44.918904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:44.919620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:44.919886 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:44.920336 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] PATH_INFO: `/v3/projects/0011052a423f474fbb79f52b04c64042` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:44.927785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0011052a423f474fbb79f52b04c64042)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:44.930134 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.093438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0011052a423f474fbb79f52b04c64042', 'request_id': 'req-24f7251a-0326-4ae5-b1ea-74f5cf29c948'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:45.103234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0011052a423f474fbb79f52b04c64042', 'request_id': 'req-24f7251a-0326-4ae5-b1ea-74f5cf29c948'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:45.199417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0011052a423f474fbb79f52b04c64042', 'request_id': 'req-24f7251a-0326-4ae5-b1ea-74f5cf29c948'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:45.223133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.223728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] The token cache is being invalidate because project 0011052a423f474fbb79f52b04c64042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:45.224364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:45.225528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:45.226029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24f7251a-0326-4ae5-b1ea-74f5cf29c948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:45.230687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1181/2349] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:44 2022] DELETE /identity/v3/projects/0011052a423f474fbb79f52b04c64042 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:45.236893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946684-f8b8-49ec-9fbd-b4b78288c178 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.237705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946684-f8b8-49ec-9fbd-b4b78288c178 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.238610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1946684-f8b8-49ec-9fbd-b4b78288c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.264942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:45.325161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c1946684-f8b8-49ec-9fbd-b4b78288c178 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:45.326566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c1946684-f8b8-49ec-9fbd-b4b78288c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:45.375003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e0cb-dd97-497f-a508-ab748f75f74f service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.404095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1182/2350] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:45.414400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.414766 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.415049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.437523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:45.439035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:45.449961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1183/2351] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:45.450536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.451611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.452116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.452624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.455226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.456722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:45.465838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6508f-c026-4f4c-bee3-f0b74f7fb162 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.472035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.472876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.473335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.473777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.474954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:29:45.475385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.477292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.480893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.483801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.495631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1184/2352] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:29:45.496782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.505297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1169/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:29:45.507862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86215edd-cedc-47eb-99a6-2f927d97e86f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.513029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.513726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.514229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.514572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.515310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.517862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.654249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1185/2354] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:45 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:29:45.658359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.671473 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b873af3-7b4a-4a64-85c0-02377bf0d182 service placement] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.754053 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:45.772350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.773409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.774937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.774937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.775531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.779309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.882899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1170/2355] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:45 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:45.887427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.899469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec480-0e92-43a1-a396-131dba6a011c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.906056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.907236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.907522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.907832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.908545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.910429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.927608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1186/2356] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:45.931784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.942663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57d94-6d18-4df0-9ecd-16ef42b5e99f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.947742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.948372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:45.948648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:45.949124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:45.949777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:45.951425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edae4c-03fa-4219-961f-f99166172c44 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:45.963334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1171/2357] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:45.971095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:45.987110 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c927582-916d-416f-a5ff-f861916ea05a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:45.993414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:45.994052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.000701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.000701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] PATH_INFO: `/v3/projects/1589f6033a6041ea9833cb80e6827275/users/e708f546189c4bf9bcbfc38c5c59ba93/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:46.014059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1589f6033a6041ea9833cb80e6827275, user_id=e708f546189c4bf9bcbfc38c5c59ba93, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:46.016675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:46.116923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1187/2358] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:45 2022] PUT /identity/v3/projects/1589f6033a6041ea9833cb80e6827275/users/e708f546189c4bf9bcbfc38c5c59ba93/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:46.128204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.128491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.128767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:46.160281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] MFA Rules not processed for user `e708f546189c4bf9bcbfc38c5c59ba93`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:46.166157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:46.236407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1172/2359] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:46.242742 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:46.324988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d25f-f428-407a-9c77-60e6bb923deb admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:46.330599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:46.331231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.331511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.331783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:46.332413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:46.334553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:46.355422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:46.497228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1188/2360] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:46 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:46.498605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:46.509915 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b43b48c-c6a1-45db-b985-b27757db20b2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:46.608478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:46.609434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.609820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.610135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:46.611132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:46.614953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:46.923820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1173/2361] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:46 2022] POST /identity/v3/users => generated 294 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:46.928202 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:46.939700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01f7fe-a263-466b-8daa-15a0ff77848a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:46.945320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:46.946183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.946530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.946887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:46.947608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:46.949314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:46.966283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1189/2362] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:46.969365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:46.983580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef77553-1547-49b9-ba01-5c021b21a262 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:46.990885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:46.991825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:46.992955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:46.992955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] PATH_INFO: `/v3/projects/afe79f96e65d406e85b3b22bb310e30c/users/ce7655d30868471c85af2d2ea11ab490/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:47.012226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe79f96e65d406e85b3b22bb310e30c, user_id=ce7655d30868471c85af2d2ea11ab490, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:47.015313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:47.210412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1174/2363] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:46 2022] PUT /identity/v3/projects/afe79f96e65d406e85b3b22bb310e30c/users/ce7655d30868471c85af2d2ea11ab490/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:47.214850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:47.226369 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d13a-6ef6-4e86-9ad5-eaf7fed35a95 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:47.325514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:47.326332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:47.326718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:47.327102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:47.327900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:47.330543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3866999-62bc-45f0-b7dd-c330868238c4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:47.342022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1190/2364] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:47.347036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:47.357745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77c01-0a7c-4f4d-8f8b-83e3da289416 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:47.362910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:47.363585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:47.363864 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:47.364140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] PATH_INFO: `/v3/projects/afe79f96e65d406e85b3b22bb310e30c/users/ce7655d30868471c85af2d2ea11ab490/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:47.366163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe79f96e65d406e85b3b22bb310e30c, user_id=ce7655d30868471c85af2d2ea11ab490, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:47.368986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:47.381417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1175/2365] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:47 2022] PUT /identity/v3/projects/afe79f96e65d406e85b3b22bb310e30c/users/ce7655d30868471c85af2d2ea11ab490/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:47.393968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:47.394209 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:47.394317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:47.424869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] MFA Rules not processed for user `ce7655d30868471c85af2d2ea11ab490`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:47.426322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:47.526916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1191/2366] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:47.537170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:47.539080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:47.557571 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:47.660759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3434f-c285-4f53-b40b-ef0171f7f715 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:47.667288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:47.669011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:47.669478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:47.670036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:47.763605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:47.765519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cff007-3dfc-4621-95a9-b593af950739 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:47.777270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1176/2367] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:29:52.249821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:52.336605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050e9be-a67e-43df-b8ba-7628721f4c0b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:52.343458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:52.344273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:52.344964 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:52.345449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] PATH_INFO: `/v3/users/e708f546189c4bf9bcbfc38c5c59ba93` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:52.347526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e708f546189c4bf9bcbfc38c5c59ba93)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:52.350018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:52.357253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:52.601059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e708f546189c4bf9bcbfc38c5c59ba93'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:52.677974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e708f546189c4bf9bcbfc38c5c59ba93'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:52.678864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e708f546189c4bf9bcbfc38c5c59ba93'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:52.679564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e708f546189c4bf9bcbfc38c5c59ba93'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:52.691060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e708f546189c4bf9bcbfc38c5c59ba93'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:52.737786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1192/2368] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:52 2022] DELETE /identity/v3/users/e708f546189c4bf9bcbfc38c5c59ba93 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:52.742644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:52.743170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:52.743170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:52.768871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:52.770048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:52.845672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1177/2369] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:52.858155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:52.860978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:52.935226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b9dd8-b4af-4db4-948d-c82a76347c8e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:52.939714 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:52.940354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:52.940632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:52.940899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:52.951819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:52.953292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:52.964982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1193/2370] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:29:53.447902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:53.447902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:53.459830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd45dff-df5d-4965-bbdb-44411d4b0a70 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:53.464640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:53.465896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:53.465896 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:53.466165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] PATH_INFO: `/v3/projects/1589f6033a6041ea9833cb80e6827275` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:53.467412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1589f6033a6041ea9833cb80e6827275)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:53.470084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:53.619432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:53.632903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1589f6033a6041ea9833cb80e6827275', 'request_id': 'req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:53.641026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1589f6033a6041ea9833cb80e6827275', 'request_id': 'req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:53.735719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1589f6033a6041ea9833cb80e6827275', 'request_id': 'req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:53.748106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] The token cache is being invalidate because project 1589f6033a6041ea9833cb80e6827275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:53.749084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:53.749084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:53.750772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1178/2371] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:53 2022] DELETE /identity/v3/projects/1589f6033a6041ea9833cb80e6827275 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:53.755784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:53.766503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c494c-ad02-4be8-896a-4b078313893e service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:53.830547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:53.831206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:53.831483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:53.831856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] PATH_INFO: `/v3/users/ce7655d30868471c85af2d2ea11ab490` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:53.833151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7655d30868471c85af2d2ea11ab490)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:53.835139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:54.037816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:54.066752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7655d30868471c85af2d2ea11ab490'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:54.152698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7655d30868471c85af2d2ea11ab490'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:54.156446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7655d30868471c85af2d2ea11ab490'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:54.156446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7655d30868471c85af2d2ea11ab490'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:54.186276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-e3f99933-703a-422b-9b37-94dabc66f962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7655d30868471c85af2d2ea11ab490'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:54.222136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1194/2372] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:29:53 2022] DELETE /identity/v3/users/ce7655d30868471c85af2d2ea11ab490 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:54.741964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:54.743616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:54.758739 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529e02a-2f4b-48fc-bd7a-a3fac68c9158 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:54.834033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:54.834886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:54.835275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:54.835987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] PATH_INFO: `/v3/projects/afe79f96e65d406e85b3b22bb310e30c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:54.838103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe79f96e65d406e85b3b22bb310e30c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:54.842422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.011345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe79f96e65d406e85b3b22bb310e30c', 'request_id': 'req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:55.018937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe79f96e65d406e85b3b22bb310e30c', 'request_id': 'req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:55.133199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe79f96e65d406e85b3b22bb310e30c', 'request_id': 'req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:55.146966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] The token cache is being invalidate because project afe79f96e65d406e85b3b22bb310e30c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:29:55.150640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:55.150640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-49473a6f-45d0-4b1b-95b3-d1c0119e31ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:29:55.150640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1179/2373] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:29:54 2022] DELETE /identity/v3/projects/afe79f96e65d406e85b3b22bb310e30c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:55.155133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.155656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.155656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.177798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:55.179642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:55.291355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1195/2374] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:55.303074 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.303358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.303632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.331756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:55.333276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:55.345612 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1180/2375] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:29:55.350960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.371488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd18118-9ae4-4348-82a6-4d5742095f0c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.381706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.382843 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.383385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.383814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.385001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:29:55.385528 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.388855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.408119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1196/2376] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:29:55.414553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.425650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552980a-f84e-487a-8f0f-efe696f56fac None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.433489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.434365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.434644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.434916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.435564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.437802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.531672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1181/2377] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:55 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:55.537127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.548450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d525836-4f87-409e-9e18-1a0ab5174344 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.614123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.614906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.615303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.615739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.616473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.618837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.701339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1197/2378] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:55 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:55.708317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.720861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a13c0-36e0-41a6-b17e-1d4aa7e68fee admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.726402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.727065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.727366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.727643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.728313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.730089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.741715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1182/2379] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:29:55.746521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.758025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d550af-3600-40a2-9f0b-71c4c60c495e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.763097 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.763737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.764007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.764280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.764942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.767234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2c078-eefe-45de-a62d-2c8fb84d83de admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.779940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1198/2380] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:29:55.794498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:55.806911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973aaf2-be73-4e87-a38a-89a7c8f05430 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:55.814186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:55.815082 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.815399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.815773 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] PATH_INFO: `/v3/projects/79ab2852821d46aeb24125189d265f43/users/0855c126e894403db7ec825e562b5a7b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:55.833792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ab2852821d46aeb24125189d265f43, user_id=0855c126e894403db7ec825e562b5a7b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:55.836487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:55.840068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:55.968885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1183/2381] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:55 2022] PUT /identity/v3/projects/79ab2852821d46aeb24125189d265f43/users/0855c126e894403db7ec825e562b5a7b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:55.977111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:55.977713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:55.978232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.015663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:56.020538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] MFA Rules not processed for user `0855c126e894403db7ec825e562b5a7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:56.021840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:56.112409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1199/2382] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:56.118281 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.203966 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718cfe-97b6-457f-bc5f-c8398fd83fce admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.211521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.212578 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.213062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.213552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.215051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.223291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.347174 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1184/2383] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:56 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:29:56.352107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.367803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049fcf6-93f9-4df7-bb8a-c88254bb9496 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.503150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.504045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.504527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.508280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.508280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.508280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.652781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1200/2384] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:56 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:56.655958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.683725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d4971-4c86-422e-ae70-278eb19971cb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.690209 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.690847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.691129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.691406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.692073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.694071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.709008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1185/2385] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:29:56.714081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.731725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7b1a-bda9-40f2-adde-9f78456202c8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.733952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.734591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.735717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.736074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.736782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.738779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0ffe0-d2d7-4a68-ab87-0fad5116fed0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.754071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1201/2386] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:56.755297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:56.765700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bff11-9ca3-48ea-a236-88fcd3cb718c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:56.770766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:56.771453 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.771762 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.772040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] PATH_INFO: `/v3/projects/a4fa748c9f97446b8a0f0415801a5999/users/b92cf79ac30c431eae913f9077280942/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:56.789176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fa748c9f97446b8a0f0415801a5999, user_id=b92cf79ac30c431eae913f9077280942, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:56.792340 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:56.899735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1186/2387] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:56 2022] PUT /identity/v3/projects/a4fa748c9f97446b8a0f0415801a5999/users/b92cf79ac30c431eae913f9077280942/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:56.970027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:56.970488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:56.970858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.000393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] MFA Rules not processed for user `b92cf79ac30c431eae913f9077280942`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:57.002392 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:57.072949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1202/2388] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:57.077572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.144799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0726d4-95c4-4ed7-adf2-35288df8ed03 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.150121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.150750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.151064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.151283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.151957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.153900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.233699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1187/2389] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:29:57 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:57.239795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.252608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1cb87-34a8-4e6b-b030-075be0150704 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.267585 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:57.352420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.353493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.354078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.354573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.355753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.359104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.512926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1203/2390] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:29:57 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:29:57.517118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.528028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af11d6-5ad2-48d9-a7e7-0db80f3e08aa admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.533144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.533763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.534080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.534359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.535015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.536644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.549024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1188/2391] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:57.553898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.565403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc80ca-3831-442a-aa4d-ccdac4fa5aa5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.571827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.572504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.572783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.573080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] PATH_INFO: `/v3/projects/c416b238e4ce40a7b695c6dacf2047df/users/5bbb012ebb744c298f0f02564010f9cf/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.589425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416b238e4ce40a7b695c6dacf2047df, user_id=5bbb012ebb744c298f0f02564010f9cf, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.592452 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.747384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1204/2392] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:57 2022] PUT /identity/v3/projects/c416b238e4ce40a7b695c6dacf2047df/users/5bbb012ebb744c298f0f02564010f9cf/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:29:57.752264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.765320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8aa82a-3a54-46e3-9d0f-3763993105dd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.804280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:57.868754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.870492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.871003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.871554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.872214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.873834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba201-9911-464e-a5bc-e4582bf540db admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.885441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1189/2393] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:29:57.890753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:57.903574 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0564-9d96-4172-ac6c-2250683c0aba admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:57.910834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:57.911532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.911806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.912070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] PATH_INFO: `/v3/projects/c416b238e4ce40a7b695c6dacf2047df/users/5bbb012ebb744c298f0f02564010f9cf/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.914221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416b238e4ce40a7b695c6dacf2047df, user_id=5bbb012ebb744c298f0f02564010f9cf, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:57.917927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:57.930853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1205/2394] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:29:57 2022] PUT /identity/v3/projects/c416b238e4ce40a7b695c6dacf2047df/users/5bbb012ebb744c298f0f02564010f9cf/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:29:57.945494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:57.946052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:57.946208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:57.977691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] MFA Rules not processed for user `5bbb012ebb744c298f0f02564010f9cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:29:57.978989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:58.068435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1190/2395] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:29:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:29:58.086289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:29:58.088090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:29:58.157395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98434b-a852-458d-95e8-4e6b319aa63d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:29:58.163458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:29:58.164212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:29:58.164490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:29:58.164764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:29:58.233129 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:29:58.234630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd1dbd-0f82-4fe7-9808-2a2227379a3f service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:29:58.245059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1206/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:29:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:01.524004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:01.536040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a52e24-b9b5-4f4d-89f3-afaa9068f8cc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:01.543854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:01.544591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:01.545022 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:01.545299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:01.654252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:01.658237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:01.694129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1191/2397] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:30:02.171612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:02.173630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:02.173942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:02.214106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:02.215530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:02.221935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:02.308829 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1207/2398] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:02.373201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:02.373201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:02.423955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:02.461505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e9f43-69a8-4e75-8b79-4a869784e2ef service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:02.467341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:02.467973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:02.468282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:02.468558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:02.479237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:02.480304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:02.495071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1192/2399] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 20:30:03.946035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:03.956956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24bcbe-d626-46b8-8f73-78e746e8cab6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:03.961093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:03.962005 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:03.965418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:03.965418 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:03.977970 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:03.980807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a004592-ec94-4799-aa38-e2de89d5cb5f service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:03.995984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1208/2400] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:10.825359 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:10.945539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fad2c-4d6e-45ae-b240-e31cf28ed79a service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:10.951752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:10.956460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:10.956460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:10.956460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] PATH_INFO: `/v3/users/0855c126e894403db7ec825e562b5a7b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:10.956460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0855c126e894403db7ec825e562b5a7b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:10.958118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:11.294880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0855c126e894403db7ec825e562b5a7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:11.357844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0855c126e894403db7ec825e562b5a7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:11.358507 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0855c126e894403db7ec825e562b5a7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:11.359121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0855c126e894403db7ec825e562b5a7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:11.372211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0855c126e894403db7ec825e562b5a7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:11.399401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1193/2401] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:10 2022] DELETE /identity/v3/users/0855c126e894403db7ec825e562b5a7b => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:11.404284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:11.405060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:11.405060 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:11.444959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:11.448281 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:11.540243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1209/2402] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:30:11.553564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:11.555422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:11.639525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:11.647977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dece72-36b5-4b07-adb7-47ce7d156ec9 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:11.654104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:11.659051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:11.659051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:11.659051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:11.677184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:11.682548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:11.704494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1194/2403] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:30:12.420694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:12.427641 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:12.452120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13a8f-ce9b-4dad-be77-d6cfc2d8bfd4 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:12.466583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:12.467356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:12.467664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:12.468009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] PATH_INFO: `/v3/projects/79ab2852821d46aeb24125189d265f43` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:12.470053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ab2852821d46aeb24125189d265f43)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:12.473019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:12.682383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ab2852821d46aeb24125189d265f43', 'request_id': 'req-fc825a9a-ca09-44c2-857e-93e59a72cd3a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:12.699109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ab2852821d46aeb24125189d265f43', 'request_id': 'req-fc825a9a-ca09-44c2-857e-93e59a72cd3a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:12.827813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ab2852821d46aeb24125189d265f43', 'request_id': 'req-fc825a9a-ca09-44c2-857e-93e59a72cd3a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:12.866538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] The token cache is being invalidate because project 79ab2852821d46aeb24125189d265f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:12.868662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:12.869854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:12.874442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1210/2404] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:12 2022] DELETE /identity/v3/projects/79ab2852821d46aeb24125189d265f43 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:12.883348 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:12.898594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4e00-c7f3-4f77-9429-a4eda2315d30 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:13.066007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:13.068590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:13.070922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:13.072298 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] PATH_INFO: `/v3/users/b92cf79ac30c431eae913f9077280942` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:13.074553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92cf79ac30c431eae913f9077280942)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:13.083901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:13.388506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92cf79ac30c431eae913f9077280942'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:13.503487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92cf79ac30c431eae913f9077280942'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:13.504629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92cf79ac30c431eae913f9077280942'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:13.505406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92cf79ac30c431eae913f9077280942'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:13.518182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92cf79ac30c431eae913f9077280942'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:13.558596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1195/2405] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:12 2022] DELETE /identity/v3/users/b92cf79ac30c431eae913f9077280942 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:14.236053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:14.237622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:14.270955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825a9a-ca09-44c2-857e-93e59a72cd3a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:14.296203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:14.446123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:14.446788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:14.447147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:14.447455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] PATH_INFO: `/v3/projects/a4fa748c9f97446b8a0f0415801a5999` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:14.448780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fa748c9f97446b8a0f0415801a5999)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:14.451125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.075820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fa748c9f97446b8a0f0415801a5999', 'request_id': 'req-ea715f5d-65a4-4448-a70c-a5cba9e48acd'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:15.083535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fa748c9f97446b8a0f0415801a5999', 'request_id': 'req-ea715f5d-65a4-4448-a70c-a5cba9e48acd'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:15.373621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fa748c9f97446b8a0f0415801a5999', 'request_id': 'req-ea715f5d-65a4-4448-a70c-a5cba9e48acd'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:15.400663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] The token cache is being invalidate because project a4fa748c9f97446b8a0f0415801a5999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:15.401372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:15.402799 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:15.405605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1211/2406] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:14 2022] DELETE /identity/v3/projects/a4fa748c9f97446b8a0f0415801a5999 => generated 0 bytes in 1171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:15.412240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:15.415813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:15.436709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81557f0-2a42-4ca7-8c5a-cf9f42211689 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:15.550376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:15.551486 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:15.551997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:15.552508 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] PATH_INFO: `/v3/users/5bbb012ebb744c298f0f02564010f9cf` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:15.554981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbb012ebb744c298f0f02564010f9cf)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:15.559106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:15.589772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:15.857253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbb012ebb744c298f0f02564010f9cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.034816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbb012ebb744c298f0f02564010f9cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.034816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbb012ebb744c298f0f02564010f9cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.035648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbb012ebb744c298f0f02564010f9cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.044347 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-db6a6df3-63af-4576-b26a-9be40d0acc12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbb012ebb744c298f0f02564010f9cf'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.065854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1196/2407] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:15 2022] DELETE /identity/v3/users/5bbb012ebb744c298f0f02564010f9cf => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:16.606278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:16.607478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:16.632706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715f5d-65a4-4448-a70c-a5cba9e48acd admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:16.712627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:16.713280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:16.713562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:16.713840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] PATH_INFO: `/v3/projects/c416b238e4ce40a7b695c6dacf2047df` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:16.715050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c416b238e4ce40a7b695c6dacf2047df)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:16.717479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:16.861730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c416b238e4ce40a7b695c6dacf2047df', 'request_id': 'req-0365946c-da33-4d22-a799-90232d78d60f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:16.863453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:16.871224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c416b238e4ce40a7b695c6dacf2047df', 'request_id': 'req-0365946c-da33-4d22-a799-90232d78d60f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:17.026756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c416b238e4ce40a7b695c6dacf2047df', 'request_id': 'req-0365946c-da33-4d22-a799-90232d78d60f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:17.041596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] The token cache is being invalidate because project c416b238e4ce40a7b695c6dacf2047df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:17.042344 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:17.042666 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-0365946c-da33-4d22-a799-90232d78d60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:17.044219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1212/2408] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:16 2022] DELETE /identity/v3/projects/c416b238e4ce40a7b695c6dacf2047df => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:17.051603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.052153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.052275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.078168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:17.079387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:17.141387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1197/2409] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:17.151535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.151858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.152139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.174099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:17.175342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:17.183298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1213/2410] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:17.187627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.197850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239131c-708c-424f-826d-619bfa1b4a00 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.202605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.203207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.203485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.203753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.204416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:30:17.204717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.207176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.220020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1198/2411] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:30:17.225301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.234783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360cbd3a-c086-4334-b10a-40d326704c2b None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.240896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.241216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.241388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.241667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.242335 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.244273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.353545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1214/2412] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:30:17 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:30:17.358391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.369572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e379c5-7056-4a07-a872-66450d6f25dc admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.434758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.435878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.435878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.436125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.436787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.439019 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.564858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1199/2413] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:30:17 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:30:17.570034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.581580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188497d-972c-48fa-ba88-ebe05273a448 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.586397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.586987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.587265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.587537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.588182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.589905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.601407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1215/2414] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:17.605934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.616938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eccc2f-0e30-497d-9e4f-d724b2683f84 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.621968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.622567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.622844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.623118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.623752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.625372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1604e39-e0d8-4267-9b08-ee73fd4a8a13 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.627638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:17.639577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1200/2415] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:30:17.645024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.655777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc6f6a-43cf-46ae-aec8-f530f462047c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:17.660896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:17.661570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.661849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.662171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] PATH_INFO: `/v3/projects/54fe801be8cd42a3b9a3733a537247a5/users/0491889f9b034c95a0fb430cb090e3f3/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.678255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fe801be8cd42a3b9a3733a537247a5, user_id=0491889f9b034c95a0fb430cb090e3f3, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:17.680950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:17.785741 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1216/2416] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:30:17 2022] PUT /identity/v3/projects/54fe801be8cd42a3b9a3733a537247a5/users/0491889f9b034c95a0fb430cb090e3f3/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:17.796346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc96f-ff78-4aba-bc17-df060d1570de None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:17.797106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc96f-ff78-4aba-bc17-df060d1570de None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:17.797106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc96f-ff78-4aba-bc17-df060d1570de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:17.830194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-02ecc96f-ff78-4aba-bc17-df060d1570de None None] MFA Rules not processed for user `0491889f9b034c95a0fb430cb090e3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:17.831456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-02ecc96f-ff78-4aba-bc17-df060d1570de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:17.936057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1201/2417] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:17.950170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:17.952637 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:18.020972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99907c-94a7-4798-9ac4-36e2eaf6278e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:18.025659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:18.026330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:18.026614 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:18.026884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:18.037232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:18.038741 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:18.049796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1217/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:20.966319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08367-0ead-4dc6-ada4-e1dd8bbdc6f1 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:20.966874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08367-0ead-4dc6-ada4-e1dd8bbdc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:20.966874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08367-0ead-4dc6-ada4-e1dd8bbdc6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:20.987730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-bde08367-0ead-4dc6-ada4-e1dd8bbdc6f1 None None] MFA Rules not processed for user `0491889f9b034c95a0fb430cb090e3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:20.989509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-bde08367-0ead-4dc6-ada4-e1dd8bbdc6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:20.996882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1202/2419] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:22.138521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:22.140009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:22.203150 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdecb5-b85b-4b72-af95-b26551084a5f service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:22.207434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:22.208035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:22.208310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:22.208580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:22.210365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:22.246999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:22.277575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:22.279142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60285d-2bfe-4550-beb0-de79f3b53692 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:22.289311 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1218/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:24.825482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:24.826088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:24.826491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:24.828588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1203/2421] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:30:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:30:24.835976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63734fa-36f1-4b71-9765-f88d3a1fa4ab None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:24.836952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63734fa-36f1-4b71-9765-f88d3a1fa4ab None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:24.836952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63734fa-36f1-4b71-9765-f88d3a1fa4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:24.879653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d63734fa-36f1-4b71-9765-f88d3a1fa4ab None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:24.879653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d63734fa-36f1-4b71-9765-f88d3a1fa4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:24.969314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1219/2422] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:30:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:30:24.984402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:24.986210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:25.049859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595492-8415-4a7d-a84e-02617d3adfd8 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:25.055572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:25.056216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.056964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.056964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.068601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:25.070098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e4d60-3f9f-4347-a071-bbfeaf3e3f42 service glance] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:25.082279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1204/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:25.423168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac657-db4f-433f-baf7-6ec7a4a0e003 None None] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.423477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac657-db4f-433f-baf7-6ec7a4a0e003 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.423749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac657-db4f-433f-baf7-6ec7a4a0e003 None None] PATH_INFO: `/` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.425650 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1220/2424] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:30:25.432112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e55b-4f54-40cd-97bf-cc0111b4a02b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.432402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e55b-4f54-40cd-97bf-cc0111b4a02b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.433176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4e55b-4f54-40cd-97bf-cc0111b4a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.454127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-cab4e55b-4f54-40cd-97bf-cc0111b4a02b None None] MFA Rules not processed for user `880635427a704e0e8107da0a07088237`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:25.455373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-cab4e55b-4f54-40cd-97bf-cc0111b4a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:25.462732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1205/2425] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:25.476935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ac657-db4f-433f-baf7-6ec7a4a0e003 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:25.490020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ac657-db4f-433f-baf7-6ec7a4a0e003 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:25.496891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:25.496891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.496891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.496891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.502315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:25.504442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b0690-8fde-4a18-99e1-a9106a9a5e25 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:25.513367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1221/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:25.601366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f68f-f969-4939-a964-ace7f0aa2fb1 None None] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.601667 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f68f-f969-4939-a964-ace7f0aa2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.601978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124f68f-f969-4939-a964-ace7f0aa2fb1 None None] PATH_INFO: `/` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.603364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1206/2427] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 17 20:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 20:30:25.610268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b9d9-5256-40a9-9271-612587d5b4b2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.610590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b9d9-5256-40a9-9271-612587d5b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.610877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7b9d9-5256-40a9-9271-612587d5b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.631965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2ee7b9d9-5256-40a9-9271-612587d5b4b2 None None] MFA Rules not processed for user `dd12e6654aad484d8edb0b82f86ba8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:25.633289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2ee7b9d9-5256-40a9-9271-612587d5b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:25.648944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1222/2428] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 17 20:30:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:25.656637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f68f-f969-4939-a964-ace7f0aa2fb1 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:25.669594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124f68f-f969-4939-a964-ace7f0aa2fb1 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:25.673198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:25.673797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:25.674106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:25.674373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:25.685630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:25.687097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:25.698493 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1207/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:29.957357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:29.958374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:29.958875 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:29.984410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:29.985662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:30.074304 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1223/2430] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:30:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:30:30.084320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:30.085827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:30.213710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:30.225780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149bedd-2e5b-4943-ac89-c38395c3af8c service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:30.232566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:30.233827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:30.234390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:30.246500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:30.250349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:30.252611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:30.274502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1208/2431] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:30:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:30:30.736965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:30.759235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b6b88-59fa-4eaf-ae5c-d9b52d829553 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:30.767517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:30.770980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:30.770980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:30.770980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:30.771543 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:30.857028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:31.044409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:31.053047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:31.100547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1224/2432] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:30:40.270952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:41.086290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=17 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:44.652786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:44.655319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:44.694137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a671c-8b36-4880-85a1-137bdac4728f service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:44.701950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:44.703131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:44.703428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:44.703713 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] PATH_INFO: `/v3/users/2a71db6cea734be0b88d03ebeb7bc144` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:44.706109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a71db6cea734be0b88d03ebeb7bc144)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:44.707576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:44.939609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a71db6cea734be0b88d03ebeb7bc144'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.021824 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a71db6cea734be0b88d03ebeb7bc144'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.022513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a71db6cea734be0b88d03ebeb7bc144'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.023141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a71db6cea734be0b88d03ebeb7bc144'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.031925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a71db6cea734be0b88d03ebeb7bc144'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.052241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1209/2433] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:44 2022] DELETE /identity/v3/users/2a71db6cea734be0b88d03ebeb7bc144 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:45.356260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.374655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab73038-e9c5-42b5-85f7-3c631ac51b96 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.450149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.450689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.450975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.452022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] PATH_INFO: `/v3/projects/f90cf866a8fb4d959f391ac98b42dda4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.452894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90cf866a8fb4d959f391ac98b42dda4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.454824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:45.573374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90cf866a8fb4d959f391ac98b42dda4', 'request_id': 'req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.587227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90cf866a8fb4d959f391ac98b42dda4', 'request_id': 'req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.673111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90cf866a8fb4d959f391ac98b42dda4', 'request_id': 'req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.686290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] The token cache is being invalidate because project f90cf866a8fb4d959f391ac98b42dda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:45.686587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.687544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:45.689050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1225/2434] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:45 2022] DELETE /identity/v3/projects/f90cf866a8fb4d959f391ac98b42dda4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:45.693976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:45.696251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:45.720312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a4388-4e1f-4868-8960-8f42ee3bf451 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:45.800753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:45.802094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:45.802094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:45.802094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] PATH_INFO: `/v3/users/7571254c7457466ea5e541a5ebaf3ab8` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:45.803254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7571254c7457466ea5e541a5ebaf3ab8)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:45.805233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:46.034163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7571254c7457466ea5e541a5ebaf3ab8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:46.215819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7571254c7457466ea5e541a5ebaf3ab8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:46.216780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7571254c7457466ea5e541a5ebaf3ab8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:46.217387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7571254c7457466ea5e541a5ebaf3ab8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:46.225993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-fce29228-22cd-4d92-9414-02af4b5be86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7571254c7457466ea5e541a5ebaf3ab8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:46.234198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:46.246820 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1210/2435] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:30:45 2022] DELETE /identity/v3/users/7571254c7457466ea5e541a5ebaf3ab8 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:30:46.699267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:46.700901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:46.732517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6e0a9-6205-4a3f-afc3-97b6d9896b8b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:46.819210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:46.819855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:46.820132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:46.820408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] PATH_INFO: `/v3/projects/b734ef4da26b4728a2c010a59bc333d1` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:46.821643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b734ef4da26b4728a2c010a59bc333d1)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:46.823656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:46.954749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:46.977839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b734ef4da26b4728a2c010a59bc333d1', 'request_id': 'req-276d2445-c0c0-40ec-a8ee-f5c587601c1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.005062 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b734ef4da26b4728a2c010a59bc333d1', 'request_id': 'req-276d2445-c0c0-40ec-a8ee-f5c587601c1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.102076 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b734ef4da26b4728a2c010a59bc333d1', 'request_id': 'req-276d2445-c0c0-40ec-a8ee-f5c587601c1b'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.121780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] The token cache is being invalidate because project b734ef4da26b4728a2c010a59bc333d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:30:47.122088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.122850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:30:47.125073 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1226/2436] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:30:46 2022] DELETE /identity/v3/projects/b734ef4da26b4728a2c010a59bc333d1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:30:53.535316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02fa6-c68b-42f7-97da-9d9420385fbf None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:53.535316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02fa6-c68b-42f7-97da-9d9420385fbf None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:53.535316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02fa6-c68b-42f7-97da-9d9420385fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:53.554582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-33c02fa6-c68b-42f7-97da-9d9420385fbf None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:30:53.555800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-33c02fa6-c68b-42f7-97da-9d9420385fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:53.611349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1211/2437] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:30:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:30:53.624871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:30:53.626397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:30:53.700347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d2445-c0c0-40ec-a8ee-f5c587601c1b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:30:53.705545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:30:53.706193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:30:53.706479 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:30:53.706755 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:30:53.716703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:30:53.718351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:30:53.728241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1227/2438] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:03.257018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aea06-cb06-4f47-9405-552e7d1cbf8a None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:03.257583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aea06-cb06-4f47-9405-552e7d1cbf8a None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:03.257583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146aea06-cb06-4f47-9405-552e7d1cbf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:03.280800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-146aea06-cb06-4f47-9405-552e7d1cbf8a None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:03.282055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-146aea06-cb06-4f47-9405-552e7d1cbf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:03.289287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1212/2439] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:31:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:03.312252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:03.324070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b7435-d50b-4a8f-8f54-492594f822f4 service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:03.329065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:03.329663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:03.329977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:03.330248 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:03.339605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:03.341205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:03.349979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1228/2440] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:31:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:04.620025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b5a2-4e59-418e-8938-2bd3f3ca0a57 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:04.620560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b5a2-4e59-418e-8938-2bd3f3ca0a57 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:04.620560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b5a2-4e59-418e-8938-2bd3f3ca0a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:04.639938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b8f8b5a2-4e59-418e-8938-2bd3f3ca0a57 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:04.641144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b8f8b5a2-4e59-418e-8938-2bd3f3ca0a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:04.650895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1213/2441] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:31:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:31:04.663540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:04.674672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915791e0-2c42-46d8-8b8f-420a6954c510 service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:04.679855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:04.681029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:04.681498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:04.681816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:04.691447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:04.693444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:04.704017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1229/2442] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:05.529754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f416eb-1d8c-4b87-b844-4b394f79ff03 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:05.530093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f416eb-1d8c-4b87-b844-4b394f79ff03 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:05.530371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f416eb-1d8c-4b87-b844-4b394f79ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:05.550070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b8f416eb-1d8c-4b87-b844-4b394f79ff03 None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:05.551309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b8f416eb-1d8c-4b87-b844-4b394f79ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:05.560243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1214/2443] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 17 20:31:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:31:05.572669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:05.584047 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbd5f6-a7d0-4c25-afea-f9c85b698e59 service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:05.589435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:05.590080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:05.590366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:05.590639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:05.599705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:05.601297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:05.610790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1230/2444] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:31:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:06.286052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436942e-41e6-4ae4-9840-78420154313d None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.286859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436942e-41e6-4ae4-9840-78420154313d None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.286859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436942e-41e6-4ae4-9840-78420154313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.306766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4436942e-41e6-4ae4-9840-78420154313d None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:06.307993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4436942e-41e6-4ae4-9840-78420154313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:06.315529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1215/2445] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:31:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:31:06.330849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:06.350715 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a07e7-01c6-49f1-9cbc-9d59378dfddc service swift] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:06.359254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:06.360317 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:06.360795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:06.361293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:06.377096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:06.380221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d269c-d8da-41bf-8140-bb37c3b33a6c service swift] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:06.396033 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1231/2446] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:09.305757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436942e-41e6-4ae4-9840-78420154313d None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:09.305757 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4436942e-41e6-4ae4-9840-78420154313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:09.391964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436942e-41e6-4ae4-9840-78420154313d None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:09.399858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:09.403396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:09.403396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:09.403396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] PATH_INFO: `/v3/users/0491889f9b034c95a0fb430cb090e3f3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:09.406349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0491889f9b034c95a0fb430cb090e3f3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:09.408080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:09.625108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0491889f9b034c95a0fb430cb090e3f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:09.718956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0491889f9b034c95a0fb430cb090e3f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:09.719570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0491889f9b034c95a0fb430cb090e3f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:09.720191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0491889f9b034c95a0fb430cb090e3f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:09.727779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0491889f9b034c95a0fb430cb090e3f3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:09.738958 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:09.750912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1216/2447] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:09 2022] DELETE /identity/v3/users/0491889f9b034c95a0fb430cb090e3f3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:09.755812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:09.756400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:09.756400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:09.778420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:09.779656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:09.835754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:09.846473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1232/2448] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:09.863535 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:09.865096 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:09.938799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911305-32cc-46d9-b43b-d9880c432358 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:09.942699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:09.943330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:09.943611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:09.943885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:09.954528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:09.956046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:09.969180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1217/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:10.248784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:10.251163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:10.279618 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998b44-1a88-4893-a443-7f4fa377d813 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:10.286942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:10.287593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:10.287876 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:10.288232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] PATH_INFO: `/v3/projects/54fe801be8cd42a3b9a3733a537247a5` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:10.289471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fe801be8cd42a3b9a3733a537247a5)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:10.291973 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:10.400851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fe801be8cd42a3b9a3733a537247a5', 'request_id': 'req-6453fec0-243e-448b-806a-7a4ca93c1cf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:10.407449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fe801be8cd42a3b9a3733a537247a5', 'request_id': 'req-6453fec0-243e-448b-806a-7a4ca93c1cf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:10.473080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fe801be8cd42a3b9a3733a537247a5', 'request_id': 'req-6453fec0-243e-448b-806a-7a4ca93c1cf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:10.487277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] The token cache is being invalidate because project 54fe801be8cd42a3b9a3733a537247a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:10.487582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:10.488291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:10.489901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1233/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:10 2022] DELETE /identity/v3/projects/54fe801be8cd42a3b9a3733a537247a5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:19.963564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=30,keystone:DELETE=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:20.483473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:33.794828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:33.804195 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f050-0198-4b56-b766-496151d9410d service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:33.857274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:33.857887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:33.858551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:33.858826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:33.860719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:33.936210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:33.938353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:33.951586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1218/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:34.038500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:34.040175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:34.104524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453fec0-243e-448b-806a-7a4ca93c1cf7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:34.108198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:34.109112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:34.109519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:34.109793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:34.114946 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:34.129430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:34.130901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:34.143325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1234/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:43.796902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:43.799132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:43.810506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af93332-bdbb-4bb4-ba3a-c021eac67327 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:43.815410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:43.816038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:43.816315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:43.816584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:43.818435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:43.894304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:43.896173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:43.910364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1219/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:44.137156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=26 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:48.135179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:48.136789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:48.153904 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a81597-8f56-4bc5-a250-8f0eafa899d9 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:48.158863 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:48.159556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:48.159839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:48.160115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] PATH_INFO: `/v3/users/bbb975a644ea4e9b9582b8e4b06357b1` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:48.161438 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb975a644ea4e9b9582b8e4b06357b1)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:48.163575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:48.397298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb975a644ea4e9b9582b8e4b06357b1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:48.467553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb975a644ea4e9b9582b8e4b06357b1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:48.468179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb975a644ea4e9b9582b8e4b06357b1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:48.468803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb975a644ea4e9b9582b8e4b06357b1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:48.476906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2326b0f0-1b89-4837-830a-8d3a7162076f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb975a644ea4e9b9582b8e4b06357b1'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:48.495472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1235/2454] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:48 2022] DELETE /identity/v3/users/bbb975a644ea4e9b9582b8e4b06357b1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:48.773101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:48.784010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daba98a-44bf-4b75-9f03-68cccf6a06a7 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:48.838771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:48.865056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:48.865689 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:48.865991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:48.866260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] PATH_INFO: `/v3/projects/c33dfb0f1ddd4ed6ae4b8baeafea619b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:48.867945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33dfb0f1ddd4ed6ae4b8baeafea619b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:48.869923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.002218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33dfb0f1ddd4ed6ae4b8baeafea619b', 'request_id': 'req-df7569b7-6b32-489b-bd65-43afe1483f09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:49.011343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33dfb0f1ddd4ed6ae4b8baeafea619b', 'request_id': 'req-df7569b7-6b32-489b-bd65-43afe1483f09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:49.097021 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33dfb0f1ddd4ed6ae4b8baeafea619b', 'request_id': 'req-df7569b7-6b32-489b-bd65-43afe1483f09'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:49.109108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] The token cache is being invalidate because project c33dfb0f1ddd4ed6ae4b8baeafea619b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:49.109399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:49.110253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df7569b7-6b32-489b-bd65-43afe1483f09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:49.111933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1220/2455] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:48 2022] DELETE /identity/v3/projects/c33dfb0f1ddd4ed6ae4b8baeafea619b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:49.117516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.117811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.118122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.138224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:49.139473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:49.215985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1236/2456] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:49.224317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.224608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.224890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.247615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:49.248778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:49.257778 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1221/2457] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:49.262205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.274492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0b74-c498-4d88-91c8-56d54240f6e0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.281122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.281760 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.282083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.282357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.283104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:31:49.283408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.285435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.299198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1237/2458] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:31:49.303495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.318257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca27da-837a-450f-9a49-57b4999c0655 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.324122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.328581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.328581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.328581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.328581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.328581 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.492938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1222/2459] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/projects => generated 355 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:49.497456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.508604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2d918-1ffd-49a6-bea8-fd93438cad62 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.566963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.567570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.567848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.568120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.568738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.570721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.578606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:49.695002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1238/2460] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/users => generated 278 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:49.699425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.710880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c25b08-caad-44e4-9d64-7702cb587a5c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.715575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.716180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.721615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.721615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.721615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.721615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.729838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1223/2461] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:49.735417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.747844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ca72-0f1a-4d51-ace0-cd493f3ea22f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.753282 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.753804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.754088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.754355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.754995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.756603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d094b5a-b1e2-42d7-b0a8-e1515f035bdc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.767862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1239/2462] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:49.772192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:49.782379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38895d44-79e2-41c0-bd8f-2f39d8a98cfd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:49.787299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:49.787933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.788226 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.788478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] PATH_INFO: `/v3/projects/dc5ee1a7d1904b7a8cdfc82cc02fa579/users/5ec394ccc58d4c18aa1a2ff0f4f181e9/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.803928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5ee1a7d1904b7a8cdfc82cc02fa579, user_id=5ec394ccc58d4c18aa1a2ff0f4f181e9, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:49.806628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:49.876814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1224/2463] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:49 2022] PUT /identity/v3/projects/dc5ee1a7d1904b7a8cdfc82cc02fa579/users/5ec394ccc58d4c18aa1a2ff0f4f181e9/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:49.889048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:49.889328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:49.889601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:49.917292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] MFA Rules not processed for user `5ec394ccc58d4c18aa1a2ff0f4f181e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:49.918580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:49.983793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1240/2464] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:49.988874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.040918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:50.051790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dbe76-33af-4d9c-86b5-fda32677d52c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.058017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.058017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.058017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.058017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.058869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.060187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.171961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1225/2465] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:49 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:50.179081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.193819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6d6d4-5c9a-4164-90d6-d581a42aa1ba None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.259789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.260500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.260856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.261198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.261937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.263992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.388029 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1241/2466] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:50 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:50.391985 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.403401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726bb10-b162-46cf-a0a6-3521bb260347 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.408080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.409392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.409783 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.410090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.410735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.412358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.422944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1226/2467] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:50.428491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.439417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc124b0-4318-49ef-8a02-df467c840222 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.444361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.445064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.445348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.445625 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] PATH_INFO: `/v3/projects/d6b4d2d17d744e52a7272efd53b264e7/users/0ba89689f5b14907ba53e171e52bfc80/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.463088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b4d2d17d744e52a7272efd53b264e7, user_id=0ba89689f5b14907ba53e171e52bfc80, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.465778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.594678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1242/2468] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:50 2022] PUT /identity/v3/projects/d6b4d2d17d744e52a7272efd53b264e7/users/0ba89689f5b14907ba53e171e52bfc80/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:50.603949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.614587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d0cec-a623-453e-a879-fbcbfeffea0a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.677055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.677664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.677968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.678237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.678875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.680458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af63508-c0a8-458d-9198-19943d129e4c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.691276 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1227/2469] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:50.695581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.707164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8015e-5902-4c8b-bf35-080f91dc507c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.712232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.712902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.713181 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.713455 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] PATH_INFO: `/v3/projects/d6b4d2d17d744e52a7272efd53b264e7/users/0ba89689f5b14907ba53e171e52bfc80/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.715469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b4d2d17d744e52a7272efd53b264e7, user_id=0ba89689f5b14907ba53e171e52bfc80, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.718481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.730156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1243/2470] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:50 2022] PUT /identity/v3/projects/d6b4d2d17d744e52a7272efd53b264e7/users/0ba89689f5b14907ba53e171e52bfc80/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:50.741239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.741518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.741794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.771274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] MFA Rules not processed for user `0ba89689f5b14907ba53e171e52bfc80`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:50.772502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:50.843076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1228/2471] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:50.854851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:50.856568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:50.879377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:50.914914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c97f57-b078-485f-b11b-b6fc0b36bafa admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:50.918918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:50.919540 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:50.919822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:50.920095 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:50.930456 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:50.931984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:50.942764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1244/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:51.200505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:51.210855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7b8e-aeae-4e89-b1b5-4cb3157cba30 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:51.214463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:51.215056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:51.215333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:51.215603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:51.266948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:51.281682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:51.283285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:51.304477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1229/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:51.694941 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:51.696556 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:51.758270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f435d-59fb-4c3f-ab38-894d304bcb82 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:51.762370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:51.762990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:51.763400 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:51.763794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:51.765469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:51.839046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:51.840468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:51.852830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1245/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:31:56.274826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:56.277498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:56.296000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cde36-f839-4966-be4b-5062a75a26f6 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:56.301586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:56.302254 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:56.302538 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:56.302815 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] PATH_INFO: `/v3/users/46b27047a70c437e8ff046a02a0db8ad` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:56.318269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b27047a70c437e8ff046a02a0db8ad)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:56.320269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:56.527861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b27047a70c437e8ff046a02a0db8ad'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:56.610922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b27047a70c437e8ff046a02a0db8ad'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:56.611547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b27047a70c437e8ff046a02a0db8ad'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:56.612189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b27047a70c437e8ff046a02a0db8ad'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:56.620545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-efeda534-e862-49b8-b66f-ff12c72dc8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b27047a70c437e8ff046a02a0db8ad'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:56.639127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1230/2475] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:31:56 2022] DELETE /identity/v3/users/46b27047a70c437e8ff046a02a0db8ad => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:56.964480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:56.975404 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f09c86-21bf-4bdd-9694-973a52cae230 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.054378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.054930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.055207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.055508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] PATH_INFO: `/v3/projects/fa0329dfefa64f94b06e6cbf623a9be4` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.067693 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0329dfefa64f94b06e6cbf623a9be4)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.069668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.076013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:57.237981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0329dfefa64f94b06e6cbf623a9be4', 'request_id': 'req-a26465a0-3c1d-45bc-85ec-5c9c15647326'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:57.244846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0329dfefa64f94b06e6cbf623a9be4', 'request_id': 'req-a26465a0-3c1d-45bc-85ec-5c9c15647326'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:57.339507 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0329dfefa64f94b06e6cbf623a9be4', 'request_id': 'req-a26465a0-3c1d-45bc-85ec-5c9c15647326'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:57.352305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] The token cache is being invalidate because project fa0329dfefa64f94b06e6cbf623a9be4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:31:57.352708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:57.353435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a26465a0-3c1d-45bc-85ec-5c9c15647326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:31:57.355173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1246/2476] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:31:56 2022] DELETE /identity/v3/projects/fa0329dfefa64f94b06e6cbf623a9be4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:31:57.360367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.360914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.360914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.384523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:57.386052 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:57.452740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1231/2477] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:57.467514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.468028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.468526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.499555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:57.500158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:57.509609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1247/2478] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:31:57.514291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.526237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077214e-3582-45e8-942b-57dbe10a694b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.531072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.531697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.532133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.532548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.533949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:31:57.533949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.536776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.549930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1232/2479] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:31:57.555109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.565815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41258c-3402-49d3-94a3-df1719f1bc91 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.576292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.576292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.576292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.576292 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.576833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.576833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.710911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1248/2480] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:31:57 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:57.715443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.727633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32152a75-34ce-4eb4-925f-01d9cfb51516 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.762879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:57.790695 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.791587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.791866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.792138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.792766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.794798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.910303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1233/2481] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:31:57 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:31:57.914758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.927679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ba11b-3dec-438c-896f-83f0a3d78e97 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.933087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.951828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1249/2482] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:31:57.953786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:57.969329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75c70e-7db1-4df7-8b54-27df478d443a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:57.975092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:57.975722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:57.976116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:57.976396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:57.977151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:57.978897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeebfe3-9273-44e9-8c0b-a8629b0d4ae6 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:57.995752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1234/2483] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:31:57.996955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:58.009214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587fbb-0f3c-43ae-931f-87825893e464 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:58.015711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:58.017425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:58.017865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:58.018339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] PATH_INFO: `/v3/projects/1f9cfe8a47b047f38859143c66a05334/users/0a42fb9b93d441c1aae37aba71cc3d4b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:58.040924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9cfe8a47b047f38859143c66a05334, user_id=0a42fb9b93d441c1aae37aba71cc3d4b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:58.046504 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:58.155833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1250/2484] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:31:57 2022] PUT /identity/v3/projects/1f9cfe8a47b047f38859143c66a05334/users/0a42fb9b93d441c1aae37aba71cc3d4b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:31:58.166710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:58.167005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:58.167279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:58.196665 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] MFA Rules not processed for user `0a42fb9b93d441c1aae37aba71cc3d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:31:58.197717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:58.304213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1235/2485] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:31:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:31:58.321758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:31:58.323640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:31:58.408949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b52ed9-d160-4dfa-9f08-d15f4235e10c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:31:58.415696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd12e6654aad484d8edb0b82f86ba8ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:31:58.416326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:31:58.416609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:31:58.416884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:31:58.426106 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:31:58.427757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a936b6-56b8-4b3f-a4e7-ac1eeb4cfc34 service nova] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:31:58.438185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1251/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:31:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:02.089873 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:02.159283 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b757b8-cf7c-4343-9b95-f5f7cff91ba0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:02.164684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251087-074f-4eab-be89-416639badecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:02.165312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251087-074f-4eab-be89-416639badecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:02.165584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251087-074f-4eab-be89-416639badecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:02.165846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251087-074f-4eab-be89-416639badecc admin admin] PATH_INFO: `/v3/users/0a42fb9b93d441c1aae37aba71cc3d4b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:02.167031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251087-074f-4eab-be89-416639badecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a42fb9b93d441c1aae37aba71cc3d4b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:02.169000 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251087-074f-4eab-be89-416639badecc admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:02.416064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:02.417221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a42fb9b93d441c1aae37aba71cc3d4b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:02.496766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a42fb9b93d441c1aae37aba71cc3d4b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:02.497647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a42fb9b93d441c1aae37aba71cc3d4b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:02.498433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a42fb9b93d441c1aae37aba71cc3d4b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:02.506890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a42fb9b93d441c1aae37aba71cc3d4b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:02.526384 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1236/2487] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:02 2022] DELETE /identity/v3/users/0a42fb9b93d441c1aae37aba71cc3d4b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:02.531089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:02.531570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:02.540353 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:02.553024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:02.554288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:02.563678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:02.624621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1252/2488] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:02.635968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:02.637662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:02.700041 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251087-074f-4eab-be89-416639badecc admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:02.703931 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:02.704623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:02.704903 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:02.705176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:02.717045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:02.718542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4561f0-95cd-450b-b41b-562f56c8ff6b service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:02.729411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1237/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:03.166591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.168185 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:03.183015 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab03a0-429f-47fa-abbb-2d14acf55206 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.188358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.189030 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.189985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.190289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] PATH_INFO: `/v3/projects/1f9cfe8a47b047f38859143c66a05334` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.196256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9cfe8a47b047f38859143c66a05334)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.198450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.327905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9cfe8a47b047f38859143c66a05334', 'request_id': 'req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:03.341332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9cfe8a47b047f38859143c66a05334', 'request_id': 'req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:03.422155 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9cfe8a47b047f38859143c66a05334', 'request_id': 'req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:03.434403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] The token cache is being invalidate because project 1f9cfe8a47b047f38859143c66a05334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:03.434699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:03.435339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cde8981e-a2c3-4d12-81a9-ce9d6630d06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:03.437054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1253/2490] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:03 2022] DELETE /identity/v3/projects/1f9cfe8a47b047f38859143c66a05334 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:03.442065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.442607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.442730 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.463558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:03.464792 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:03.528513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1238/2491] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:03.538639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.539130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.539217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.561573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:03.563137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:03.572276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1254/2492] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:03.576874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.587319 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926eadc-0ee9-4b51-888b-798eadef879b None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.600607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.600607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.600607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.600607 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.600992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:03.600992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.600992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.616786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1239/2493] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:03.617740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.627824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295bb9-bdd0-41ba-8acb-0e0dda3d6921 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.634840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.634840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.634840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.634840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.635343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.636590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.748569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1255/2494] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:03 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:03.752861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.763722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076937-762f-4039-8bce-3590574d981c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.818834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:03.828260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.828900 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.829274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.829542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.830220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.833515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.923406 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1240/2495] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:03 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:03.927638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.938283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70998fb-dd1a-4f64-80e2-fd622f76e599 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.943341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.943937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.944215 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.944482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.945113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.946739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.957189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1256/2496] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:03.966852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:03.977833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316ffac-1cca-48b3-a189-4f2beea07386 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:03.982644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:03.983239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:03.983517 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:03.983787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:03.984430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:03.986060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc20267-bfa7-4808-aa67-b28a6c307dad admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:03.997167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1241/2497] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:04.001405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.011701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96beaa-7b7d-4266-b503-285dc089a461 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.016550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.017349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.017677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.018054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] PATH_INFO: `/v3/projects/69ef7f64e6094c93bbee6a6d2ad2baaf/users/da18a9795baa49108ceb4f5ad48eea77/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.036227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ef7f64e6094c93bbee6a6d2ad2baaf, user_id=da18a9795baa49108ceb4f5ad48eea77, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.040208 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.195363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1257/2498] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:04 2022] PUT /identity/v3/projects/69ef7f64e6094c93bbee6a6d2ad2baaf/users/da18a9795baa49108ceb4f5ad48eea77/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:04.206290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.206648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.207520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.236306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] MFA Rules not processed for user `da18a9795baa49108ceb4f5ad48eea77`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:04.237536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:04.339056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1242/2499] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:04.344024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.398038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:04.430288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.430288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:04.447064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef324b-8ac2-4468-9f3d-a20b758c3333 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.458603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.459962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.460623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.461547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.463444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.469286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.510982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086374c-993a-4cd2-8aa4-816b5ec1f1f5 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.514834 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.515464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.515741 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.516007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.517910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:04.531424 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.532884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.543764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1243/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:04.596125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1258/2501] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:04 2022] POST /identity/v3/projects => generated 365 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:04.598044 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.609489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c600e-b005-42dd-8a10-f46055eda6a3 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.682825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.683484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.683759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.684025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.684654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.686715 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.698279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:04.806594 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1244/2502] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:04 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:04.810572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.823657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ae7e1-fe32-4793-99cf-aedb00592bb4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.828658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.829313 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.829643 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.829943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.830599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.832416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.847797 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1259/2503] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:04.852492 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.863631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f4420-e584-4796-9fb5-69e772647bb7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:04.869806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:04.870602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:04.870878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:04.871148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] PATH_INFO: `/v3/projects/1809d9a570d145e6886d30ce44b325cc/users/fb2fd826a3be4c87b8867e69a3cac2c3/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:04.888330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809d9a570d145e6886d30ce44b325cc, user_id=fb2fd826a3be4c87b8867e69a3cac2c3, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:04.891071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:04.965847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1245/2504] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:04 2022] PUT /identity/v3/projects/1809d9a570d145e6886d30ce44b325cc/users/fb2fd826a3be4c87b8867e69a3cac2c3/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:04.970162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:04.981383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084552bf-2037-4b34-a698-5dac6b068043 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:05.041044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:05.041750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:05.041981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:05.042256 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:05.042905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:05.044515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071f54f-3668-4b82-9fb6-cbe05045cfa4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:05.055792 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1260/2505] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:05.059940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:05.071753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ea14d-3b72-4fbb-bdca-fcf26a0bfb3c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:05.076489 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:05.077147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:05.077426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:05.077697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] PATH_INFO: `/v3/projects/1809d9a570d145e6886d30ce44b325cc/users/fb2fd826a3be4c87b8867e69a3cac2c3/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:05.079676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809d9a570d145e6886d30ce44b325cc, user_id=fb2fd826a3be4c87b8867e69a3cac2c3, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:05.082462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:05.095230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1246/2506] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:05 2022] PUT /identity/v3/projects/1809d9a570d145e6886d30ce44b325cc/users/fb2fd826a3be4c87b8867e69a3cac2c3/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:05.106042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:05.106427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:05.106812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:05.135382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] MFA Rules not processed for user `fb2fd826a3be4c87b8867e69a3cac2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:05.136704 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:05.209318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1261/2507] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:05.221171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:05.223456 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:05.285504 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca388fc9-0d5d-476e-8766-3e0b9c0ca841 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:05.289586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:05.290075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:05.290361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:05.290629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:05.301338 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:05.302872 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58572c-1823-43f8-b77a-c603bd424ac6 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:05.313583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1247/2508] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:06.576401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:06.614233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:06.659756 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda493f3-3075-4cec-a31e-ca7a1127b447 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:06.674827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:06.675516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:06.676006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:06.676512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] PATH_INFO: `/v3/users/da18a9795baa49108ceb4f5ad48eea77` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:06.678123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da18a9795baa49108ceb4f5ad48eea77)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:06.680889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:06.952906 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da18a9795baa49108ceb4f5ad48eea77'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:07.063049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da18a9795baa49108ceb4f5ad48eea77'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:07.063049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da18a9795baa49108ceb4f5ad48eea77'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:07.063049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da18a9795baa49108ceb4f5ad48eea77'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:07.073527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da18a9795baa49108ceb4f5ad48eea77'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:07.128905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1262/2509] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:06 2022] DELETE /identity/v3/users/da18a9795baa49108ceb4f5ad48eea77 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:07.134528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:07.135091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:07.137597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:07.170314 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:07.171666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:07.269925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1248/2510] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:07.285113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:07.286943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:07.380929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113aca-e6d4-4f7a-b4aa-bc66b83df698 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:07.385172 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:07.386122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:07.386309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:07.386713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:07.402171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:07.404825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:07.416969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1263/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:07.956211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:07.959264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:08.021961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4b346-0422-4914-b6b9-7bb402707d40 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:08.038377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:08.039599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:08.039754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:08.040118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] PATH_INFO: `/v3/projects/69ef7f64e6094c93bbee6a6d2ad2baaf` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:08.042063 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ef7f64e6094c93bbee6a6d2ad2baaf)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:08.048825 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:08.236075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ef7f64e6094c93bbee6a6d2ad2baaf', 'request_id': 'req-f40068f3-b115-4c16-a599-b0fa4efc53b3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.246565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ef7f64e6094c93bbee6a6d2ad2baaf', 'request_id': 'req-f40068f3-b115-4c16-a599-b0fa4efc53b3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.249506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:08.372062 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ef7f64e6094c93bbee6a6d2ad2baaf', 'request_id': 'req-f40068f3-b115-4c16-a599-b0fa4efc53b3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.395509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] The token cache is being invalidate because project 69ef7f64e6094c93bbee6a6d2ad2baaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:08.395924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.396601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.403121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:08.403636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1249/2512] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:07 2022] DELETE /identity/v3/projects/69ef7f64e6094c93bbee6a6d2ad2baaf => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:08.413343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b095-60a4-4625-8335-2633c1ca0832 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:08.505296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:08.515266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:08.515915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:08.516676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:08.516676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] PATH_INFO: `/v3/users/fb2fd826a3be4c87b8867e69a3cac2c3` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:08.517590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2fd826a3be4c87b8867e69a3cac2c3)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:08.519839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:08.796559 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2fd826a3be4c87b8867e69a3cac2c3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.891056 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2fd826a3be4c87b8867e69a3cac2c3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.895804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2fd826a3be4c87b8867e69a3cac2c3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.895804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2fd826a3be4c87b8867e69a3cac2c3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.904539 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2fd826a3be4c87b8867e69a3cac2c3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:08.926707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1264/2513] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:08 2022] DELETE /identity/v3/users/fb2fd826a3be4c87b8867e69a3cac2c3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:09.788736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:09.790353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:09.813828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40068f3-b115-4c16-a599-b0fa4efc53b3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:09.829642 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:09.831277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:09.945316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39075194-e81d-4240-be13-876828b8f0f5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:09.953709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:09.954263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:09.954448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:09.954750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] PATH_INFO: `/v3/projects/1809d9a570d145e6886d30ce44b325cc` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:09.961469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1809d9a570d145e6886d30ce44b325cc)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:09.964074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.026888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:10.027555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.027838 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.028117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] PATH_INFO: `/v3/users/2e9acd97be994f3ca7e36732f28470c2` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.061992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9acd97be994f3ca7e36732f28470c2)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:10.066162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.160420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1809d9a570d145e6886d30ce44b325cc', 'request_id': 'req-c9133919-60e5-4d3f-8335-72e4793954dc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.167644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1809d9a570d145e6886d30ce44b325cc', 'request_id': 'req-c9133919-60e5-4d3f-8335-72e4793954dc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.242751 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1809d9a570d145e6886d30ce44b325cc', 'request_id': 'req-c9133919-60e5-4d3f-8335-72e4793954dc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.254954 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] The token cache is being invalidate because project 1809d9a570d145e6886d30ce44b325cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:10.255261 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.255897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c9133919-60e5-4d3f-8335-72e4793954dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.257421 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1265/2514] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:09 2022] DELETE /identity/v3/projects/1809d9a570d145e6886d30ce44b325cc => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:10.266910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6e66c-e2bc-49fa-b647-65abd4a3b6a6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.269493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6e66c-e2bc-49fa-b647-65abd4a3b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.269493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6e66c-e2bc-49fa-b647-65abd4a3b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.275752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.289826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6fc6e66c-e2bc-49fa-b647-65abd4a3b6a6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:10.291136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6fc6e66c-e2bc-49fa-b647-65abd4a3b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:10.349775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9acd97be994f3ca7e36732f28470c2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.361461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1266/2515] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:10.372003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.372341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.372608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.395268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:10.395268 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:10.404977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1267/2516] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:10.409329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:10.420132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12121c9-808f-4dd3-958b-3b706200b9f3 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:10.425736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:10.426502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.429486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.429486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.429486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:10.429486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:10.430545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.448969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1268/2517] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:32:10.454326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:10.457350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9acd97be994f3ca7e36732f28470c2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.458077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9acd97be994f3ca7e36732f28470c2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.458822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9acd97be994f3ca7e36732f28470c2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.469140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9acd97be994f3ca7e36732f28470c2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:10.479477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6f8b1-c806-43ee-ab29-d3420c46f7a4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:10.487745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:10.489463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.489935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.490500 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.492594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:10.493429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.501392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1250/2518] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:09 2022] DELETE /identity/v3/users/2e9acd97be994f3ca7e36732f28470c2 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:10.602681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1269/2519] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:10 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:10.606320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:10.608294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:10.698183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.717123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0d2cd-355a-4f5a-962e-f3d0e655bdf1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:10.818733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:10.819976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.820393 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.820798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.821541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:10.824036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.840086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:10.841165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:10.861538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d6c48-aeb5-4c97-92d1-3eae38ac701a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:10.868607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:10.869450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:10.870187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:10.870380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] PATH_INFO: `/v3/projects/364fc437561449b68b69ed4380bca24b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:10.884297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364fc437561449b68b69ed4380bca24b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:10.886424 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:10.977906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1251/2520] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:10 2022] POST /identity/v3/users => generated 292 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:10.982070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:10.994010 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2adb82-93c0-4bc4-a73d-b89517c55571 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:10.998812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.000069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.000069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.000069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.000633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.002272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.012472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1252/2521] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:11.016361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.026417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86f116-c2e2-4866-a0ce-f8b6fcd00c7d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.031505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.036675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.036675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.036675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.036675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.036675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.047533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1253/2522] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:11.052266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.058841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364fc437561449b68b69ed4380bca24b', 'request_id': 'req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:11.064135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e41ca-0c8d-4f7e-908e-bb0854c0b784 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.066959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364fc437561449b68b69ed4380bca24b', 'request_id': 'req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:11.129361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.130059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.130341 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.130630 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] PATH_INFO: `/v3/projects/6bf5656a1fe54d8dbdd165382c9d8ba9/users/20d7ca1650ee4446a3bc2dd0feb36324/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.145103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364fc437561449b68b69ed4380bca24b', 'request_id': 'req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:11.148452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf5656a1fe54d8dbdd165382c9d8ba9, user_id=20d7ca1650ee4446a3bc2dd0feb36324, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.151260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b636ee-b45c-42b8-970e-3b81163c8b45 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.157824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] The token cache is being invalidate because project 364fc437561449b68b69ed4380bca24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:11.158337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:11.159257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-7d70e6b2-6a33-48e7-bc73-0541de98c3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:11.161632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1270/2523] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:10 2022] DELETE /identity/v3/projects/364fc437561449b68b69ed4380bca24b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:11.166817 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3263-4b57-47b0-aa29-126e9b5bd43c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.167044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3263-4b57-47b0-aa29-126e9b5bd43c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.167316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a3263-4b57-47b0-aa29-126e9b5bd43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.190236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4e6a3263-4b57-47b0-aa29-126e9b5bd43c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:11.191933 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4e6a3263-4b57-47b0-aa29-126e9b5bd43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.199969 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1271/2524] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:11.208342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396756e-3328-4789-af07-1ce68a04105f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.211624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396756e-3328-4789-af07-1ce68a04105f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.211624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396756e-3328-4789-af07-1ce68a04105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.229705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c396756e-3328-4789-af07-1ce68a04105f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:11.230958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c396756e-3328-4789-af07-1ce68a04105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.240366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1272/2525] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:11.244834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396756e-3328-4789-af07-1ce68a04105f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.254431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396756e-3328-4789-af07-1ce68a04105f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.259962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.261255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.261983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.269859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.269859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:11.269859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.269859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.275131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1254/2526] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:11 2022] PUT /identity/v3/projects/6bf5656a1fe54d8dbdd165382c9d8ba9/users/20d7ca1650ee4446a3bc2dd0feb36324/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:11.285968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.286389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.286606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.289511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1273/2527] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:32:11.292882 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.311417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33055137-dfad-4054-b177-6dbc26e960b8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.315955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] MFA Rules not processed for user `20d7ca1650ee4446a3bc2dd0feb36324`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:11.317406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.317569 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.361513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.378692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.380491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.380853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.381177 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.381845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.383877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.392663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1255/2528] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:11.400333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.402440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:11.417747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072f5e1-de73-495e-8d3f-cdeafd4dcea3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.423085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.423698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.423944 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.424215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.424888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.426978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.545355 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1274/2529] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/projects => generated 405 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:11.550570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.584387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1256/2530] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:11.589405 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.636093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6cc27-dc0e-4e53-b89f-fc2f8d8e7568 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.700016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92d2f-2ba8-4758-a586-b5515b0d707a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.709374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.709714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.710213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.710635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.711337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.713913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.715812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.716672 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.716982 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.717279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.717864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.719814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.855358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1257/2531] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:11.856111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1275/2532] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:11 2022] POST /identity/v3/users => generated 303 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:11.856787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.857126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.867165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccda81-2855-4400-8eea-6aebe79a5d72 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.868077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429266-1c99-4ef5-9fac-bba66cd2de71 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.872071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.872672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.872947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.873105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.873216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.873558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.873819 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.874039 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.874159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.874743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.875465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.876359 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.886936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1258/2533] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:11.889512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1276/2534] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:11.892880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.893045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.903710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e8e6e-bf02-45d6-b650-ed58cbf9f565 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.903951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf95b-3f4e-43e6-9d1e-6544d3a72c23 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.908938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.909437 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.909651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.909963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.910241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.910837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.911007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.911429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.911854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] PATH_INFO: `/v3/projects/3e13bd0ae1c34085807efc10be95f5dd/users/fec68b3d5ed644d28737c9d704c4b19a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.912631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.924267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1277/2535] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:11.928865 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:11.930934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e13bd0ae1c34085807efc10be95f5dd, user_id=fec68b3d5ed644d28737c9d704c4b19a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.933582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:11.939851 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c571661-b1aa-4b69-bade-e27bb2d17b0f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:11.945362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:11.946092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:11.946412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:11.946678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] PATH_INFO: `/v3/projects/26b8e636d4bf4757ba210df95868cfc4/users/998f7cb359ea463d9bd0222b199aa067/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:11.949897 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.962305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b8e636d4bf4757ba210df95868cfc4, user_id=998f7cb359ea463d9bd0222b199aa067, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:11.965088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eeed1-0de3-4b5b-b4cd-8d9de6588ffb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.033673 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1259/2536] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:11 2022] PUT /identity/v3/projects/3e13bd0ae1c34085807efc10be95f5dd/users/fec68b3d5ed644d28737c9d704c4b19a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:12.038046 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.090907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1278/2537] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:11 2022] PUT /identity/v3/projects/26b8e636d4bf4757ba210df95868cfc4/users/998f7cb359ea463d9bd0222b199aa067/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:12.103401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cafb3-a9e5-40d4-9a7d-71d0f007ff68 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.103779 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cafb3-a9e5-40d4-9a7d-71d0f007ff68 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.103977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9d23-116b-41f3-896d-0374fbb7e7c0 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.104093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003cafb3-a9e5-40d4-9a7d-71d0f007ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.120511 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:12.138278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-003cafb3-a9e5-40d4-9a7d-71d0f007ff68 None None] MFA Rules not processed for user `998f7cb359ea463d9bd0222b199aa067`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:12.139512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-003cafb3-a9e5-40d4-9a7d-71d0f007ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:12.176895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.177542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.177997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.178408 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.179219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.181458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.197305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1260/2538] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:12.198505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.209137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180683f-40d5-4ec0-a534-27a4561f9072 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.214830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.215431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.216097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.216976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] PATH_INFO: `/v3/projects/3e13bd0ae1c34085807efc10be95f5dd/users/fec68b3d5ed644d28737c9d704c4b19a/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.219601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e13bd0ae1c34085807efc10be95f5dd, user_id=fec68b3d5ed644d28737c9d704c4b19a, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.222780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.234541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1261/2539] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:12 2022] PUT /identity/v3/projects/3e13bd0ae1c34085807efc10be95f5dd/users/fec68b3d5ed644d28737c9d704c4b19a/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:12.235495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1279/2540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:12.236370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.247320 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.247567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.247845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.278142 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] MFA Rules not processed for user `fec68b3d5ed644d28737c9d704c4b19a`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:12.279380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:12.319608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f9467-d865-4158-b4a4-1ec63cb3b75b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.324910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.325522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.325794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.326101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.326732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.328649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.358365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1280/2541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:12.369793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.371702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:12.429563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeec279-df4e-41c2-b23d-03fa52b57149 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.433295 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.438858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.438858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.438858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.439139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1262/2542] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:12 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:12.441636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.445325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.447553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.457674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1281/2543] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:12.511049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b54ed-2776-445a-9449-06e71d9fe1f6 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.516085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.516696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.516974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.517245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.517863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.520284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.565944 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.576859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:12.576859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643ad9-950c-420a-846c-2056c777ec90 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.603267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1263/2544] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:12 2022] POST /identity/v3/users => generated 308 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:12.614324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.624478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641d61-5809-4189-bc71-f7b83f8bd315 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.629514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.629684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.630233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.630371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.630510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.630651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.630804 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.630968 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.631617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.633265 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.659289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1264/2545] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:12.664554 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.670908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:12.675596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5571ac3-65b4-4f6d-a389-be2df6a3cade admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.680840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.681485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.681759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.682068 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] PATH_INFO: `/v3/projects/01879b58657b4585b0cbcd94b73007a3/users/5a404d3818d84d78b940c507a6b5ec59/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.693207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.695229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.702073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01879b58657b4585b0cbcd94b73007a3, user_id=5a404d3818d84d78b940c507a6b5ec59, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.704749 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.705410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1282/2546] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:12.783874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1265/2547] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:12 2022] PUT /identity/v3/projects/01879b58657b4585b0cbcd94b73007a3/users/5a404d3818d84d78b940c507a6b5ec59/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:12.788094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.799151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1141e-8204-486d-a2c5-413399bd9091 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.874416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.875552 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.875920 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.876414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.877599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.884253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc4460-5e8b-4cd6-aaf9-e2ff7151bc03 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.898323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1283/2548] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:12.902883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:12.915008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e27f9d-95f0-4970-ae60-dec7f092eb42 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:12.920780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:12.921461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.921806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.922111 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] PATH_INFO: `/v3/projects/01879b58657b4585b0cbcd94b73007a3/users/5a404d3818d84d78b940c507a6b5ec59/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.924098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01879b58657b4585b0cbcd94b73007a3, user_id=5a404d3818d84d78b940c507a6b5ec59, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:12.927928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:12.944279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1266/2549] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:12 2022] PUT /identity/v3/projects/01879b58657b4585b0cbcd94b73007a3/users/5a404d3818d84d78b940c507a6b5ec59/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:12.955887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:12.956231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:12.956517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:12.989086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] MFA Rules not processed for user `5a404d3818d84d78b940c507a6b5ec59`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:12.990361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.064619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1284/2550] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:13.092417 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:13.233735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:13.235522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.297480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f476cd6-6669-4d9a-8afe-85c6f6091a50 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:13.302048 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:13.302656 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:13.302936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:13.303207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:13.312827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:13.314280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:13.324284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1267/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:13.370871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:13.372532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.462857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297a345-55fe-45f7-be7f-54aa10488127 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:13.468487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:13.469688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:13.469688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:13.469688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] PATH_INFO: `/v3/users/5ec394ccc58d4c18aa1a2ff0f4f181e9` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:13.472488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec394ccc58d4c18aa1a2ff0f4f181e9)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:13.474838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:13.495322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:13.513064 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8998170-c22e-4b1f-be0d-bd82dc1e4f40 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:13.550161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:13.550161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:13.550161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:13.550161 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] PATH_INFO: `/v3/users/998f7cb359ea463d9bd0222b199aa067` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:13.550597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998f7cb359ea463d9bd0222b199aa067)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:13.550597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:13.731265 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec394ccc58d4c18aa1a2ff0f4f181e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.810893 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec394ccc58d4c18aa1a2ff0f4f181e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.811705 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec394ccc58d4c18aa1a2ff0f4f181e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.812611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec394ccc58d4c18aa1a2ff0f4f181e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.821472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-03c73277-7dc3-48e6-b067-a0322a65c454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec394ccc58d4c18aa1a2ff0f4f181e9'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.828072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998f7cb359ea463d9bd0222b199aa067'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.840204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1285/2552] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:13 2022] DELETE /identity/v3/users/5ec394ccc58d4c18aa1a2ff0f4f181e9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:13.844787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:13.849802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:13.849802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:13.865189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:13.866459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.894275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998f7cb359ea463d9bd0222b199aa067'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.895202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998f7cb359ea463d9bd0222b199aa067'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.895904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998f7cb359ea463d9bd0222b199aa067'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.904523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b731a55a-0a7a-476b-be02-2d96b2386d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998f7cb359ea463d9bd0222b199aa067'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:13.923594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:13.926192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1268/2553] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:13 2022] DELETE /identity/v3/users/998f7cb359ea463d9bd0222b199aa067 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:13.930572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:13.930865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:13.931238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:13.936845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1286/2554] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:13.945873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:13.947813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.953371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:13.954615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:13.996296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:14.009440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c095062-16a3-442a-9f5a-5f19001751a0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:14.019449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1269/2555] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:14.028798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:14.073861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:14.074515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:14.074793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:14.075066 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:14.087287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:14.088370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:14.094162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330571fe-eab6-427f-bb09-764e5638e945 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:14.098116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:14.098735 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:14.099017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:14.099293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:14.100867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1287/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:14.110054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:14.111619 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:14.123170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1270/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:14.810420 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:14.812329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:14.826671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf361-dfda-4f7d-9100-a7f9c35a5218 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:14.831589 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:14.832690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:14.833224 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:14.833401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] PATH_INFO: `/v3/projects/dc5ee1a7d1904b7a8cdfc82cc02fa579` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:14.834858 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5ee1a7d1904b7a8cdfc82cc02fa579)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:14.836790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:14.849392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:14.851084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:14.867726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b444da-54eb-4ec4-9a32-e08540944b18 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:14.874235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:14.875213 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:14.875565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:14.875787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] PATH_INFO: `/v3/projects/26b8e636d4bf4757ba210df95868cfc4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:14.877026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b8e636d4bf4757ba210df95868cfc4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:14.879126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:15.023251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5ee1a7d1904b7a8cdfc82cc02fa579', 'request_id': 'req-a3f6d236-1473-4687-8030-46008e61ece2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.029484 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5ee1a7d1904b7a8cdfc82cc02fa579', 'request_id': 'req-a3f6d236-1473-4687-8030-46008e61ece2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.090814 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b8e636d4bf4757ba210df95868cfc4', 'request_id': 'req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.098365 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b8e636d4bf4757ba210df95868cfc4', 'request_id': 'req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.146135 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5ee1a7d1904b7a8cdfc82cc02fa579', 'request_id': 'req-a3f6d236-1473-4687-8030-46008e61ece2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.157310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] The token cache is being invalidate because project dc5ee1a7d1904b7a8cdfc82cc02fa579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:15.157595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.158269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.160357 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1288/2558] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:14 2022] DELETE /identity/v3/projects/dc5ee1a7d1904b7a8cdfc82cc02fa579 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:15.164377 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:15.165746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:15.199323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b8e636d4bf4757ba210df95868cfc4', 'request_id': 'req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.209907 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:15.211764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] The token cache is being invalidate because project 26b8e636d4bf4757ba210df95868cfc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:15.212061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.212723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.214267 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1271/2559] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:14 2022] DELETE /identity/v3/projects/26b8e636d4bf4757ba210df95868cfc4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:15.218448 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:15.219941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:15.231690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6d236-1473-4687-8030-46008e61ece2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:15.294813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d4f2c-c3f1-499a-8cf7-584c5c83114a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:15.299794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:15.300192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:15.300434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:15.300717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:15.300848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:15.300990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] PATH_INFO: `/v3/users/5a404d3818d84d78b940c507a6b5ec59` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:15.301099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:15.301343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] PATH_INFO: `/v3/users/0ba89689f5b14907ba53e171e52bfc80` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:15.302506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a404d3818d84d78b940c507a6b5ec59)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:15.302663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba89689f5b14907ba53e171e52bfc80)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:15.304694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:15.304820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:15.316892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:15.538664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba89689f5b14907ba53e171e52bfc80'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.561310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a404d3818d84d78b940c507a6b5ec59'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.641362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba89689f5b14907ba53e171e52bfc80'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.641362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba89689f5b14907ba53e171e52bfc80'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.641362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba89689f5b14907ba53e171e52bfc80'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.650769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba89689f5b14907ba53e171e52bfc80'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.669990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1289/2560] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:15 2022] DELETE /identity/v3/users/0ba89689f5b14907ba53e171e52bfc80 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:15.747389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a404d3818d84d78b940c507a6b5ec59'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.748149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a404d3818d84d78b940c507a6b5ec59'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.748819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a404d3818d84d78b940c507a6b5ec59'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.757442 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a404d3818d84d78b940c507a6b5ec59'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:15.777574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1272/2561] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:15 2022] DELETE /identity/v3/users/5a404d3818d84d78b940c507a6b5ec59 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:16.137908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.139462 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.226374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0846-3a45-43c1-9775-70312364fe72 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.235434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:16.287059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.289271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.312220 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.314286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.314286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.314286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] PATH_INFO: `/v3/projects/d6b4d2d17d744e52a7272efd53b264e7` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.315611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b4d2d17d744e52a7272efd53b264e7)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.318889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.375313 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89067f21-4822-49f7-8079-a9334371e73e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.380639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.381273 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.381548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.381826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] PATH_INFO: `/v3/projects/01879b58657b4585b0cbcd94b73007a3` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.382980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01879b58657b4585b0cbcd94b73007a3)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.385004 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.472514 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b4d2d17d744e52a7272efd53b264e7', 'request_id': 'req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.479239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b4d2d17d744e52a7272efd53b264e7', 'request_id': 'req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.555583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01879b58657b4585b0cbcd94b73007a3', 'request_id': 'req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.562146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01879b58657b4585b0cbcd94b73007a3', 'request_id': 'req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.565010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b4d2d17d744e52a7272efd53b264e7', 'request_id': 'req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.577655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] The token cache is being invalidate because project d6b4d2d17d744e52a7272efd53b264e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:16.577947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.578576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-3e04167d-1630-4e54-a72c-dc7a9afa4e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.584409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1290/2562] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:16 2022] DELETE /identity/v3/projects/d6b4d2d17d744e52a7272efd53b264e7 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:16.585999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d622d-55e2-48c8-87a6-72cc675991b8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.586309 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d622d-55e2-48c8-87a6-72cc675991b8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.586583 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d622d-55e2-48c8-87a6-72cc675991b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.623491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-142d622d-55e2-48c8-87a6-72cc675991b8 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:16.627845 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-142d622d-55e2-48c8-87a6-72cc675991b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.666892 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01879b58657b4585b0cbcd94b73007a3', 'request_id': 'req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.703649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] The token cache is being invalidate because project 01879b58657b4585b0cbcd94b73007a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:16.704047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.704930 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4d46b0d5-dd79-4a98-93d3-1b6b4fcbdb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:16.707540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1273/2563] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:16 2022] DELETE /identity/v3/projects/01879b58657b4585b0cbcd94b73007a3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:16.712379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bd9f-6c40-4aab-a30e-b6b182108143 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.713018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bd9f-6c40-4aab-a30e-b6b182108143 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.713346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630bd9f-6c40-4aab-a30e-b6b182108143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.731408 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1291/2564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:16.738502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9630bd9f-6c40-4aab-a30e-b6b182108143 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:16.739848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.739994 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9630bd9f-6c40-4aab-a30e-b6b182108143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.740244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.740581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.749708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1274/2565] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:16.758549 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.759005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.759178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.764349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:16.765587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.776263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1292/2566] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:16.780609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.782435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:16.783942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:16.792109 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3aa50-9d9d-441f-a9ad-691114b62e13 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.796099 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1275/2567] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:16.797244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.800046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.800046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.800046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.800046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:16.800046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.801461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.803960 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.809918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:16.813822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa013-943a-45dc-8fb5-8877ea9c9e64 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.819812 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.820483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.820984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.821103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1293/2568] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:32:16.821203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.821660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:16.821991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.823693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.828194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.838225 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1276/2569] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:32:16.840402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c13bb-a28a-4159-970a-1b3600953627 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.842646 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.845681 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.846365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.846652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.847499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.848526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.850351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.854038 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e533dc9-aa81-45d3-b381-cd33b61eb1f9 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:16.860193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:16.860795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:16.861073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:16.861337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:16.862012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:16.864598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:16.965570 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1294/2570] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:16.967143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:16.974136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1277/2571] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:16.978583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.046356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944da7c3-cb8c-4400-a6c1-8d8f184331b2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.053329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.053995 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.054284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.054575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.055195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.055867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa03fac-20ec-4c76-95f5-f8e0cf85b3cd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.057157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.061165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.062373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.062750 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.063117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.063862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.067449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.142324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1295/2572] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:17.143276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.145517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.157856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf67-2afd-47fc-aedc-689bb9c0c5dc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.164287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.165827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.166052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.166707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] PATH_INFO: `/v3/users/20d7ca1650ee4446a3bc2dd0feb36324` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.168600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d7ca1650ee4446a3bc2dd0feb36324)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.172158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.173351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1278/2573] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:16 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:17.174651 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.189847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c3207-2b94-40a6-9d4c-d111cf6f17ca admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.196631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.197236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.201134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.201134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.201134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.201134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.211343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1279/2574] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:17.212187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.223160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb671faa-38e0-4613-89e5-f036800f247e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.228145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.228759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.229155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.229355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.230037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.231638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.242724 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1280/2575] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:17.245701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.256305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977f5dd-b9c6-4a23-a335-bbe39dd305a2 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.261050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.261652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.261959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.262232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.262890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.264509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.276001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1281/2576] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:17.276846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.286982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb616ca4-c95b-42c1-9aac-2c873419a8b0 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.291697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.292458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.292562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.292819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.293460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.295091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.306230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1282/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:17.307121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.317627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5d3af-2bdd-4826-882a-4612f0f057aa admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.322449 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.323108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.323386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.323657 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] PATH_INFO: `/v3/projects/7f8a1f1dd18d40fbb7343cd7f50fc6a7/users/0217278499924d3393a3b02d38886bbc/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.339107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8a1f1dd18d40fbb7343cd7f50fc6a7, user_id=0217278499924d3393a3b02d38886bbc, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.342085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.370825 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d7ca1650ee4446a3bc2dd0feb36324'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:17.409040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1283/2578] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:17 2022] PUT /identity/v3/projects/7f8a1f1dd18d40fbb7343cd7f50fc6a7/users/0217278499924d3393a3b02d38886bbc/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:17.410468 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.434551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d7ca1650ee4446a3bc2dd0feb36324'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:17.435194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d7ca1650ee4446a3bc2dd0feb36324'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:17.435821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d7ca1650ee4446a3bc2dd0feb36324'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:17.445302 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-a2563e67-250b-4dbb-87ed-04d025a676fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d7ca1650ee4446a3bc2dd0feb36324'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:17.463003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1296/2579] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:17 2022] DELETE /identity/v3/users/20d7ca1650ee4446a3bc2dd0feb36324 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:17.466257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4177-fdb6-4a69-a9bd-f7b0019bd2db None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.466257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4177-fdb6-4a69-a9bd-f7b0019bd2db None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.466257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a4177-fdb6-4a69-a9bd-f7b0019bd2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.482777 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee9493-b897-4d95-bcc7-b930377d7308 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.495978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-b32a4177-fdb6-4a69-a9bd-f7b0019bd2db None None] MFA Rules not processed for user `0217278499924d3393a3b02d38886bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:17.497754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b32a4177-fdb6-4a69-a9bd-f7b0019bd2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.546388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.547057 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.547335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.547699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] PATH_INFO: `/v3/projects/42d619988cb746198686a72629f8435e/users/7c53a36b3bd040ef9c18f75fefc8783c/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.564608 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d619988cb746198686a72629f8435e, user_id=7c53a36b3bd040ef9c18f75fefc8783c, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.567095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.571380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1297/2580] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:17.572689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.572976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.573249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.596926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:17.598700 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.606789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1298/2581] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:17.607573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.608856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.622128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a2f18-f267-490b-a846-8d4b0f46e8ec None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.627259 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.627874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.628723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.629017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.629656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.631706 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8754b6-cba0-44c5-aa41-ff72930e68e1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.648546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1284/2582] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:17 2022] PUT /identity/v3/projects/42d619988cb746198686a72629f8435e/users/7c53a36b3bd040ef9c18f75fefc8783c/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:17.649443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.651205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.723562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9d547-2dfc-4019-a622-1917318dac73 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.727980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.728614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.728893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.729177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.768381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1299/2583] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:17.770673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.771034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.771391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.804034 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] MFA Rules not processed for user `7c53a36b3bd040ef9c18f75fefc8783c`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:17.805410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.828175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:17.842241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.843861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:17.857465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1285/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:17.859532 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.875745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2d0c-9652-449c-93ba-3024f8197282 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:17.915710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1300/2585] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:17.923464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:17.927628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:17.981601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:17.998089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:17.998089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:17.998089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:17.998089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:17.998089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.019182 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a2a0b-41cc-4867-871f-41f7396d115f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.024077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.024690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.024974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.025250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.025902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.027841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.205906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1286/2586] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/users => generated 289 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:18.207612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1301/2587] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:17 2022] POST /identity/v3/projects => generated 365 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:18.210407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.211558 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.225035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e795e-0a99-4232-a2a3-b44c90bce542 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.296707 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.298288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.298723 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.299164 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.299999 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.301345 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cf31d-7fed-43de-974d-8c7e7c43dcae admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.302734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.306343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.307065 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.307412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.307757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.308457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.310517 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.315349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1287/2588] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:18.320236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.331924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032dcad-f4f0-46e7-a00e-698f69ae435e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.337089 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:18.339229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.339919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.340191 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.340467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] PATH_INFO: `/v3/projects/dbd8219f9d594e6bb448cd76d76f1503/users/1f3101ab1ab64148bd77c6db1dbd0e51/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.356857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8219f9d594e6bb448cd76d76f1503, user_id=1f3101ab1ab64148bd77c6db1dbd0e51, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.359552 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.451221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1302/2589] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:18 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:18.455395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.467606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bd312-ab62-4a3d-bd30-c13e5bc7f606 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.476668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.478071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.478599 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.479024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.480157 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.484729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.485138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1288/2590] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:18 2022] PUT /identity/v3/projects/dbd8219f9d594e6bb448cd76d76f1503/users/1f3101ab1ab64148bd77c6db1dbd0e51/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:18.485138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.493742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:18.499795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1303/2591] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:18.500266 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.521665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c466bbe-5dfc-48b0-b152-509eb376c0c0 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.574683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243c76-4738-4445-a59b-a14d5bcca553 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.579353 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.580114 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.580236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.580501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] PATH_INFO: `/v3/projects/6bf5656a1fe54d8dbdd165382c9d8ba9` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.583054 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf5656a1fe54d8dbdd165382c9d8ba9)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.584867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.585025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.585562 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.585844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.586149 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.586814 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.588422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.600226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1304/2592] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:18.601124 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.612130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe08cc24-b7bd-4719-af83-19ec8eaf776b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.617280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.617968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.618249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.618520 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] PATH_INFO: `/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e/users/1a5c8ee1a2ae48e7a355eb12f9c1d136/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.634290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ec29ef6c624e0c84ee6f50edf1a07e, user_id=1a5c8ee1a2ae48e7a355eb12f9c1d136, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.636961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.797491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1305/2593] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:18 2022] PUT /identity/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e/users/1a5c8ee1a2ae48e7a355eb12f9c1d136/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:18.798524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.807763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf5656a1fe54d8dbdd165382c9d8ba9', 'request_id': 'req-f56429b6-34fd-471c-8549-2adcdecee5d6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:18.817300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf5656a1fe54d8dbdd165382c9d8ba9', 'request_id': 'req-f56429b6-34fd-471c-8549-2adcdecee5d6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:18.866838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ab89f-47a2-497a-859f-f0960726fec6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:18.926105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:18.926830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:18.927111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:18.927385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] PATH_INFO: `/v3/projects/dbd8219f9d594e6bb448cd76d76f1503/users/1f3101ab1ab64148bd77c6db1dbd0e51/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:18.929354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd8219f9d594e6bb448cd76d76f1503, user_id=1f3101ab1ab64148bd77c6db1dbd0e51, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:18.932025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:18.942974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1306/2594] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:18 2022] PUT /identity/v3/projects/dbd8219f9d594e6bb448cd76d76f1503/users/1f3101ab1ab64148bd77c6db1dbd0e51/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:18.943932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:18.949446 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:18.993687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf5656a1fe54d8dbdd165382c9d8ba9', 'request_id': 'req-f56429b6-34fd-471c-8549-2adcdecee5d6'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.012156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] The token cache is being invalidate because project 6bf5656a1fe54d8dbdd165382c9d8ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:19.012441 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.013243 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f56429b6-34fd-471c-8549-2adcdecee5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.017787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1289/2595] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:18 2022] DELETE /identity/v3/projects/6bf5656a1fe54d8dbdd165382c9d8ba9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:19.018016 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca042f-6bab-4bc7-b28c-76e7c712fe83 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.018146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d142-b8d3-4446-9ea4-ab9dae7652ea None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.018146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d142-b8d3-4446-9ea4-ab9dae7652ea None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.018146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d142-b8d3-4446-9ea4-ab9dae7652ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.022601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.023354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.023738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.024119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.024910 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.032197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.039640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1307/2596] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:19.040037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.042653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.049117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0fd5d142-b8d3-4446-9ea4-ab9dae7652ea None None] MFA Rules not processed for user `1f3101ab1ab64148bd77c6db1dbd0e51`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:19.050643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0fd5d142-b8d3-4446-9ea4-ab9dae7652ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.057239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e0d77-108c-4662-8b0c-0ce2f0bb0154 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.062474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.063121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.063403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.063669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] PATH_INFO: `/v3/users/fec68b3d5ed644d28737c9d704c4b19a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.064837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec68b3d5ed644d28737c9d704c4b19a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.068205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.136434 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1290/2597] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:19.137736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.139186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:19.139709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.140090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.193918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] MFA Rules not processed for user `e5e97d95774e4618a71c8b864d29dc3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:19.195192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.254322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec68b3d5ed644d28737c9d704c4b19a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.265403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1291/2598] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 17 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:19.266361 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.267729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.284821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0458-c265-4bf9-8d62-1eb56272bdfe None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.291413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.292075 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.292350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.292718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] PATH_INFO: `/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e/users/1a5c8ee1a2ae48e7a355eb12f9c1d136/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.295371 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ec29ef6c624e0c84ee6f50edf1a07e, user_id=1a5c8ee1a2ae48e7a355eb12f9c1d136, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.298280 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.325162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1292/2599] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:19 2022] PUT /identity/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e/users/1a5c8ee1a2ae48e7a355eb12f9c1d136/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:19.325162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.325162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.371826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6831a9-4003-4202-bdad-22b9587cd783 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.375428 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.376031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.376308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.376577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.411832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec68b3d5ed644d28737c9d704c4b19a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.412310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec68b3d5ed644d28737c9d704c4b19a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.413018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec68b3d5ed644d28737c9d704c4b19a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.421429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-26e9738b-cee3-4cf4-9569-feaf8a92fc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec68b3d5ed644d28737c9d704c4b19a'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:19.438643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.440147 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.440363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1308/2600] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:19 2022] DELETE /identity/v3/users/fec68b3d5ed644d28737c9d704c4b19a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:19.441774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.442080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.442349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.465480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1293/2601] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:19.468309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.470193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.486595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] MFA Rules not processed for user `1a5c8ee1a2ae48e7a355eb12f9c1d136`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:19.489228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.568296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1309/2602] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:19.580577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.582018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.583073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c82ac6-a932-45a3-998a-3a14e2912ad1 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.649767 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e9234-8779-4b82-9e10-46c819ea16a7 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.653605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.654299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.654656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.654932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.659476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2598eac7e63d4e4385d2c7510fa16528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.660478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.660697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.661274 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.663216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.666143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.667984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.680083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1310/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:19.726880 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.728541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.738194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1294/2604] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 17 20:32:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 20:32:19.762121 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.763844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.778780 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1da82-ed4b-4d64-a540-4b5ea95ac19c service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.782762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.783586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.783912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.784139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.786502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.855782 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:19.857461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:19.868627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1311/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:19.944685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:19.954098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd8d95-37fa-43bf-83f6-abaf39f43103 service swift] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:19.957774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:19.958400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:19.958677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:19.958943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:19.960721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:19.974201 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:20.029976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:20.031432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc82a5-ccf2-424f-bbd5-be5a10dc7bab service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:20.040951 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1295/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:20.143103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:20.150436 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:20.152080 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:20.230075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db90c3-5c01-4763-a41a-cec3dd801c80 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:20.234745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:20.235385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.235668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.235943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] PATH_INFO: `/v3/projects/3e13bd0ae1c34085807efc10be95f5dd` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.237092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e13bd0ae1c34085807efc10be95f5dd)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:20.239929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:20.418440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e13bd0ae1c34085807efc10be95f5dd', 'request_id': 'req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:20.424635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e13bd0ae1c34085807efc10be95f5dd', 'request_id': 'req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:20.525098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e13bd0ae1c34085807efc10be95f5dd', 'request_id': 'req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:20.537364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] The token cache is being invalidate because project 3e13bd0ae1c34085807efc10be95f5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:20.537657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:20.546197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-b2ebef7b-fe1b-4f59-b203-28d0f9047de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:20.546197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1312/2607] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:20 2022] DELETE /identity/v3/projects/3e13bd0ae1c34085807efc10be95f5dd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:20.546431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.546431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.546431 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.568184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:20.569628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:20.659186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1296/2608] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:20.667788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.668075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.668361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.692342 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:20.693508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:20.701821 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1313/2609] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:20.706870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:20.716826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52312964-9cfb-4298-853a-e8fe5ad2d5ae None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:20.729198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:20.730506 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.731095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.731776 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.732887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:20.733379 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:20.735462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:20.757780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1297/2610] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:20.762445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:20.773798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beefbe-0db1-4519-8784-a56cd7a5c4dc None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:20.778987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:20.779718 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.780083 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.780364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.781019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:20.783105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:20.912299 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1314/2611] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:20 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:20.917413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:20.928551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a88ff-f0b9-4867-9360-8b6e50b9d86b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:20.986404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:20.986933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:20.987210 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:20.987534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:20.988309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:20.990251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.116426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1298/2612] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:20 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:21.120947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:21.134091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb90873-55b2-41ac-ba95-fd55216e5300 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:21.139087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:21.139734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.140067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.140340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.140988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:21.142689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.154158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1315/2613] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:21.158678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:21.169420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a145e1e-2da7-4079-8269-3a025c1b4166 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:21.174181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:21.174819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.175957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.176289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.176883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:21.178555 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75fa4-e27f-4e93-8278-94d1f2ceb654 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.190445 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1299/2614] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:21.199809 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:21.210275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19dc4-5861-4f5a-9ffc-3c3ca5c303dc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:21.215111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:21.215757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.216031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.216301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] PATH_INFO: `/v3/projects/2aa592d7a3634908832bfcb401d2a62a/users/738e3e11463d422196dd8f9407b6d8ef/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.232683 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa592d7a3634908832bfcb401d2a62a, user_id=738e3e11463d422196dd8f9407b6d8ef, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:21.235544 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.245269 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:21.327258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1316/2615] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:21 2022] PUT /identity/v3/projects/2aa592d7a3634908832bfcb401d2a62a/users/738e3e11463d422196dd8f9407b6d8ef/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:21.337503 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.337790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.338101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.370380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] MFA Rules not processed for user `738e3e11463d422196dd8f9407b6d8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:21.371721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:21.403698 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:21.442257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1300/2616] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:21.453914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:21.455806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:21.494163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:21.523481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869967d8-0d52-4182-a020-01c859de6ca4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:21.527827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:21.528444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.528723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.538692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.538692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:21.540071 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c545b-662a-4db8-afba-92503d675982 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.549611 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1317/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:21.571718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:21.628813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:21.647763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c530-2d5b-4c6c-8abf-1436fe8035b0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:21.653154 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:21.653811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:21.654123 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:21.654452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] PATH_INFO: `/v3/users/738e3e11463d422196dd8f9407b6d8ef` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:21.655929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738e3e11463d422196dd8f9407b6d8ef)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:21.658025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:21.794118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:21.951277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738e3e11463d422196dd8f9407b6d8ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:22.036520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738e3e11463d422196dd8f9407b6d8ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:22.036736 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=100 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:22.037362 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738e3e11463d422196dd8f9407b6d8ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:22.038014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738e3e11463d422196dd8f9407b6d8ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:22.045704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738e3e11463d422196dd8f9407b6d8ef'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:22.063869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1301/2618] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:21 2022] DELETE /identity/v3/users/738e3e11463d422196dd8f9407b6d8ef => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:22.069602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:22.069867 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:22.070227 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:22.093963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:22.095422 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:22.105611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:22.165515 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1318/2619] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:22.179178 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:22.180663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:22.239843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6390d9-e4f9-44e6-bfb5-184d043f2860 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:22.251287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:22.251991 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:22.257904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:22.258327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:22.273946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:22.275414 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a354db-f760-4964-8330-60eb4088d910 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:22.286682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1302/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:22.511818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:22.889846 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:22.891503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:22.905035 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cc6db-f9d2-47f5-890f-59462869479c None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:22.911806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:22.912903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:22.913415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:22.913690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] PATH_INFO: `/v3/projects/2aa592d7a3634908832bfcb401d2a62a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:22.915315 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa592d7a3634908832bfcb401d2a62a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:22.917303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.015905 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa592d7a3634908832bfcb401d2a62a', 'request_id': 'req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:23.024391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa592d7a3634908832bfcb401d2a62a', 'request_id': 'req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:23.141830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa592d7a3634908832bfcb401d2a62a', 'request_id': 'req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:23.159628 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] The token cache is being invalidate because project 2aa592d7a3634908832bfcb401d2a62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:23.159922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:23.160595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-75d1d70d-5636-4abc-a4d2-634a04b1d9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:23.162219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1319/2621] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:22 2022] DELETE /identity/v3/projects/2aa592d7a3634908832bfcb401d2a62a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:23.167228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.167852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.167970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.193997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:23.195288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:23.274828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1303/2622] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:23.284445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.285582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.286122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.311040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:23.312509 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:23.321786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1320/2623] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:23.326272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.338301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba2aec-8581-46e0-b877-f9fd38e9e7f7 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.344077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.344906 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.348516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.348516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.348516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:23.348516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.349001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.365187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1304/2624] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:32:23.369370 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.380903 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717f8cf-0d06-4e7b-a3b1-a81411842c56 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.386860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.387710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.388852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.389491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.390457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.392883 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.516473 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1321/2625] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:23 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:23.521536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.537013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b240859-5dfb-4c2d-8e92-843f73155633 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.564478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:23.619277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.620186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.620531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.620869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.621859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.630077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.728086 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1305/2626] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:23 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:23.730538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.749443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c51a8-05b5-400b-aa95-b234e3146f92 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.758171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.759333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.759945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.760753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.762002 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.764275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.782037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1322/2627] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:23.782774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.800658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec844a6-e0b4-411e-ba7a-0917c056b48b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.806410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.807031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.807309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.807579 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.808294 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.810228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6930e0-39b3-4f82-a7f0-980c7d547fbc admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.823681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1306/2628] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:23.828226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:23.842358 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c8ee8-3df5-49e4-9b21-abeff27fcb25 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:23.847874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:23.855117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:23.855117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:23.855117 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] PATH_INFO: `/v3/projects/73595ab2d2364d89b440caeb67ce0dfc/users/b6167145d9704b79b513305428016264/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:23.868601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73595ab2d2364d89b440caeb67ce0dfc, user_id=b6167145d9704b79b513305428016264, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:23.871378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:23.995158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1323/2629] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:23 2022] PUT /identity/v3/projects/73595ab2d2364d89b440caeb67ce0dfc/users/b6167145d9704b79b513305428016264/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:24.006810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:24.007098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:24.007376 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:24.041259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] MFA Rules not processed for user `b6167145d9704b79b513305428016264`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:24.042529 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:24.067989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:24.069988 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:24.139904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1307/2630] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:24.153863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:24.156596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:24.158272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:24.167656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24cd14-247c-46c1-89f4-6dc678d1c2b8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:24.175367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:24.176199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:24.176557 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:24.176912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] PATH_INFO: `/v3/users/7c53a36b3bd040ef9c18f75fefc8783c` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:24.178690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c53a36b3bd040ef9c18f75fefc8783c)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:24.180730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:24.247699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a4737-09b8-4277-a500-66a2ae35c084 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:24.251653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a6be002b144dea05cfd340fdb173f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:24.252325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:24.252611 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:24.252908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:24.268229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:24.270759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9118ef2-dce0-49a1-8c90-d1d7c948c389 service glance] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:24.282253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1308/2631] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:24.503761 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c53a36b3bd040ef9c18f75fefc8783c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:24.577763 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c53a36b3bd040ef9c18f75fefc8783c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:24.579764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c53a36b3bd040ef9c18f75fefc8783c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:24.580491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c53a36b3bd040ef9c18f75fefc8783c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:24.589218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c53a36b3bd040ef9c18f75fefc8783c'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:24.608252 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1324/2632] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:24 2022] DELETE /identity/v3/users/7c53a36b3bd040ef9c18f75fefc8783c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:24.612945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:24.613239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:24.613514 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:24.638677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:24.640005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:24.676287 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:24.707407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1309/2633] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:24.719551 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:24.720961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:24.790951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d25ae-313b-43cc-aa91-2976a335bb31 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:24.796945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:24.798280 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:24.798626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:24.798968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:24.828655 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:24.830334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:24.845800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1325/2634] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:25.531110 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:25.533470 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:25.572071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eff68-1d20-4690-a7ac-be98cced0c48 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:25.581023 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:25.582187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:25.586236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:25.586430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] PATH_INFO: `/v3/projects/42d619988cb746198686a72629f8435e` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:25.593026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d619988cb746198686a72629f8435e)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:25.606638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:25.802106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d619988cb746198686a72629f8435e', 'request_id': 'req-952d2137-143d-4bac-8e11-1cb3b8561373'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:25.817234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d619988cb746198686a72629f8435e', 'request_id': 'req-952d2137-143d-4bac-8e11-1cb3b8561373'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:25.902904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d619988cb746198686a72629f8435e', 'request_id': 'req-952d2137-143d-4bac-8e11-1cb3b8561373'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:25.922883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] The token cache is being invalidate because project 42d619988cb746198686a72629f8435e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:25.923541 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:25.924587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:25.927799 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1310/2635] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:25 2022] DELETE /identity/v3/projects/42d619988cb746198686a72629f8435e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:25.932770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:25.947107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51ac5-758c-4150-9bb3-61470736b179 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:26.053273 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:26.054296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:26.054662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:26.055513 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] PATH_INFO: `/v3/users/1a5c8ee1a2ae48e7a355eb12f9c1d136` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:26.056542 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5c8ee1a2ae48e7a355eb12f9c1d136)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:26.058696 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:26.095999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:26.335737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5c8ee1a2ae48e7a355eb12f9c1d136'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:26.410249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5c8ee1a2ae48e7a355eb12f9c1d136'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:26.411012 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5c8ee1a2ae48e7a355eb12f9c1d136'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:26.413069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5c8ee1a2ae48e7a355eb12f9c1d136'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:26.433271 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-449e7a01-1466-4864-b681-9580d00a24c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5c8ee1a2ae48e7a355eb12f9c1d136'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:26.476917 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1326/2636] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:25 2022] DELETE /identity/v3/users/1a5c8ee1a2ae48e7a355eb12f9c1d136 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:27.058070 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:27.059878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:27.093692 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2137-143d-4bac-8e11-1cb3b8561373 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:27.172335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:27.173505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:27.174136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:27.174589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] PATH_INFO: `/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:27.177693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ec29ef6c624e0c84ee6f50edf1a07e)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:27.180322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:27.327083 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ec29ef6c624e0c84ee6f50edf1a07e', 'request_id': 'req-9649c9cd-3152-406d-b2a7-352849647c04'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:27.337132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ec29ef6c624e0c84ee6f50edf1a07e', 'request_id': 'req-9649c9cd-3152-406d-b2a7-352849647c04'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:27.479935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ec29ef6c624e0c84ee6f50edf1a07e', 'request_id': 'req-9649c9cd-3152-406d-b2a7-352849647c04'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:27.486505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:27.511476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] The token cache is being invalidate because project a1ec29ef6c624e0c84ee6f50edf1a07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:27.511927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:27.530525 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9649c9cd-3152-406d-b2a7-352849647c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:27.534971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1311/2637] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:27 2022] DELETE /identity/v3/projects/a1ec29ef6c624e0c84ee6f50edf1a07e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:27.540612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:27.541334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:27.541334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:27.568737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:27.570156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:27.665481 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1327/2638] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:27.676616 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:27.677382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:27.678135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:27.722540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:27.724547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:27.737753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1312/2639] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:27.745010 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:27.759945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475caec-2633-4cff-b00b-8390ebdfaeae None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:27.766496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:27.766496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:27.766496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:27.766496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:27.767069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:27.767371 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:27.770214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:27.790590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1328/2640] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:27.796593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:27.812633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066f0c8-f589-4f83-b1f1-765932b3e2a5 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:27.821233 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:27.822262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:27.822716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:27.823160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:27.824206 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:27.827357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:27.956780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1313/2641] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:27 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:27.961805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:27.978234 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82414-a637-497d-b9e2-62703e6e4f06 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:28.088530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:28.089186 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.089529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.089841 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.091554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:28.093132 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:28.232478 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1329/2642] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:27 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:28.234229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:28.250957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483491d-e8f0-49cd-bba8-737b69d2222a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:28.260533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:28.264425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.265215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.265934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.267224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:28.276853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:28.308009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1314/2643] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:28.312620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:28.329768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203cbb06-3469-48ee-b613-3e42ebcffba9 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:28.342805 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:28.343900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.344254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.344979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.346137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:28.350827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6d5b-0526-45e4-ac16-e49cc3b9b87e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:28.372695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1330/2644] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:28.380425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:28.393278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c504f58-e1fb-47f3-8122-8748ff427b5c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:28.403440 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:28.404655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.405235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.405841 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] PATH_INFO: `/v3/projects/626e717c13094f57bc91e3c080029d89/users/32928ee70cfd4735be06f675ffffa228/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.433965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626e717c13094f57bc91e3c080029d89, user_id=32928ee70cfd4735be06f675ffffa228, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:28.437672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:28.565196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1315/2645] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:28 2022] PUT /identity/v3/projects/626e717c13094f57bc91e3c080029d89/users/32928ee70cfd4735be06f675ffffa228/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:28.579468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.580011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.580011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.600457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:28.660429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] MFA Rules not processed for user `32928ee70cfd4735be06f675ffffa228`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:28.662077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:28.774429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1331/2646] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:28.779050 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:28.873139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334c771-1cb1-4381-bfd2-f53bdcc8e159 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:28.879590 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:28.880438 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:28.880860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:28.880860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:28.882011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:28.884218 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:28.979240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1316/2647] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:28 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:28.983597 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:28.995689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5275550-f90d-475e-8e65-c308690672a6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:29.069924 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:29.070459 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.070774 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.071049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.071689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:29.073630 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:29.288291 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1332/2648] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:28 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:29.292870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:29.305455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e48a0f-1e05-47d6-bf4a-d4fc450ecc2a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:29.313632 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:29.314358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.314731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.314976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.321177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:29.329364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:29.349255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1317/2649] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:29.351523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:29.364913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095f52-b20c-4e20-ae02-2f9abd642877 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:29.371231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:29.372409 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.372833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.373203 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] PATH_INFO: `/v3/projects/9f5df82f8be14b41ae846d1693ebf25a/users/6d82a7e39ef84b399eed032f76a8cd7f/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.406807 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5df82f8be14b41ae846d1693ebf25a, user_id=6d82a7e39ef84b399eed032f76a8cd7f, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:29.410612 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:29.545127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1333/2650] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:29 2022] PUT /identity/v3/projects/9f5df82f8be14b41ae846d1693ebf25a/users/6d82a7e39ef84b399eed032f76a8cd7f/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:29.551804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:29.564545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f1469-c44e-4d50-9a6f-1ed6cac51938 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:29.630388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:29.630940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.631224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.631502 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.632177 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:29.633857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf5212-cefc-46ee-b7cb-3455cfc924f7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:29.635600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:29.653260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1318/2651] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:29.657411 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:29.669657 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78ec7-8fa8-49c8-93f9-fabb7931582c admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:29.676707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:29.677678 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.677977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.678152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] PATH_INFO: `/v3/projects/9f5df82f8be14b41ae846d1693ebf25a/users/6d82a7e39ef84b399eed032f76a8cd7f/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.680136 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5df82f8be14b41ae846d1693ebf25a, user_id=6d82a7e39ef84b399eed032f76a8cd7f, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:29.683118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:29.712567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1334/2652] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:29 2022] PUT /identity/v3/projects/9f5df82f8be14b41ae846d1693ebf25a/users/6d82a7e39ef84b399eed032f76a8cd7f/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:29.719998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:29.719998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:29.719998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:29.773967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] MFA Rules not processed for user `6d82a7e39ef84b399eed032f76a8cd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:29.775644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:29.914461 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1319/2653] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:29.932877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:29.935321 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:30.038300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:30.055447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d5424-c10b-45c4-94c3-ac8a5aa8db2f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:30.064985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:30.066855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:30.067383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:30.067891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:30.088482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:30.091822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:30.114492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1335/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:30.369229 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:30.371681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:30.396916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43df6a8-5994-42e0-9e08-56311b9dcb95 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:30.405071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:30.405938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:30.406377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:30.406811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:30.521221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:30.523073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:30.539753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1320/2655] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:31.214912 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:31.217116 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:31.235107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:31.248380 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:31.349427 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1ce3-3bf2-43b1-a654-bd487e56147e service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:31.354758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:31.355469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:31.355682 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:31.356131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] PATH_INFO: `/v3/users/facbc1ded061421fa287f04ad83de24f` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:31.357074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=facbc1ded061421fa287f04ad83de24f)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:31.380582 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:31.383542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d49fc-37c0-46ca-a769-7c324dbcea15 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:31.410127 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:31.415482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:31.415482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:31.415482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] PATH_INFO: `/v3/users/0217278499924d3393a3b02d38886bbc` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:31.415482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0217278499924d3393a3b02d38886bbc)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:31.415482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:31.449304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:31.751505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0217278499924d3393a3b02d38886bbc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.803837 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facbc1ded061421fa287f04ad83de24f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.876974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0217278499924d3393a3b02d38886bbc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.877849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0217278499924d3393a3b02d38886bbc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.879480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0217278499924d3393a3b02d38886bbc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.889671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6b228b42-d7d1-41ad-8bc1-3016692dc0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0217278499924d3393a3b02d38886bbc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:31.922017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1321/2656] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:31 2022] DELETE /identity/v3/users/0217278499924d3393a3b02d38886bbc => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:31.928003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:31.928289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:31.928570 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:31.950766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:31.952032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:32.021182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1322/2657] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:32.032766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:32.035465 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:32.109374 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f261fa8-572d-44be-ac73-4bb17af42ebd None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:32.115603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:32.116279 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:32.116653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:32.116959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:32.128188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:32.129861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:32.132298 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facbc1ded061421fa287f04ad83de24f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.133164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facbc1ded061421fa287f04ad83de24f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.133795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facbc1ded061421fa287f04ad83de24f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.222013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facbc1ded061421fa287f04ad83de24f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.222774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1323/2658] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:32.222880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1336/2659] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:31 2022] DELETE /identity/v3/users/facbc1ded061421fa287f04ad83de24f => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:32.498899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:32.505918 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:32.544117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbe6f-a2cc-4272-bd74-b04419865402 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:32.647446 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:32.670187 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:32.674483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:32.697802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:32.698521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:32.698816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:32.699116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] PATH_INFO: `/v3/projects/498b5991a58f4b7e92d97d466e764950` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:32.700697 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498b5991a58f4b7e92d97d466e764950)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:32.702840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:32.767104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17127f9a-48f5-4007-a9d6-24584edef114 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:32.776338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:32.777228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:32.777716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:32.778258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] PATH_INFO: `/v3/projects/7f8a1f1dd18d40fbb7343cd7f50fc6a7` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:32.780728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8a1f1dd18d40fbb7343cd7f50fc6a7)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:32.783877 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:32.806679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:32.865388 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498b5991a58f4b7e92d97d466e764950', 'request_id': 'req-5d02439b-cd5b-4ff1-ba5b-900801700fe3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.874574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498b5991a58f4b7e92d97d466e764950', 'request_id': 'req-5d02439b-cd5b-4ff1-ba5b-900801700fe3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.931225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8a1f1dd18d40fbb7343cd7f50fc6a7', 'request_id': 'req-cd565649-0e1b-456a-8c5d-25f345b914d3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.939133 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8a1f1dd18d40fbb7343cd7f50fc6a7', 'request_id': 'req-cd565649-0e1b-456a-8c5d-25f345b914d3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:32.991764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498b5991a58f4b7e92d97d466e764950', 'request_id': 'req-5d02439b-cd5b-4ff1-ba5b-900801700fe3'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.012983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] The token cache is being invalidate because project 498b5991a58f4b7e92d97d466e764950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:33.013474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.014563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.017166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1324/2660] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:32 2022] DELETE /identity/v3/projects/498b5991a58f4b7e92d97d466e764950 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:33.022860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:33.026466 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:33.086834 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8a1f1dd18d40fbb7343cd7f50fc6a7', 'request_id': 'req-cd565649-0e1b-456a-8c5d-25f345b914d3'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.125616 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] The token cache is being invalidate because project 7f8a1f1dd18d40fbb7343cd7f50fc6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:33.126247 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.130901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.130901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1337/2661] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:32 2022] DELETE /identity/v3/projects/7f8a1f1dd18d40fbb7343cd7f50fc6a7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:33.137092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:33.141925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:33.147687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02439b-cd5b-4ff1-ba5b-900801700fe3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:33.236149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:33.237952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:33.237952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:33.237952 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] PATH_INFO: `/v3/users/480384fc52cc4b2eb01531a08dc85ed0` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:33.239866 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480384fc52cc4b2eb01531a08dc85ed0)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:33.243387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:33.258725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd565649-0e1b-456a-8c5d-25f345b914d3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:33.267675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:33.267902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:33.268890 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:33.269490 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] PATH_INFO: `/v3/users/1f3101ab1ab64148bd77c6db1dbd0e51` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:33.271242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3101ab1ab64148bd77c6db1dbd0e51)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:33.274327 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:33.454320 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480384fc52cc4b2eb01531a08dc85ed0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.539854 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3101ab1ab64148bd77c6db1dbd0e51'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.549031 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480384fc52cc4b2eb01531a08dc85ed0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.550158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480384fc52cc4b2eb01531a08dc85ed0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.551286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480384fc52cc4b2eb01531a08dc85ed0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.564821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480384fc52cc4b2eb01531a08dc85ed0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.588764 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1325/2662] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:33 2022] DELETE /identity/v3/users/480384fc52cc4b2eb01531a08dc85ed0 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:33.668972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3101ab1ab64148bd77c6db1dbd0e51'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.670094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3101ab1ab64148bd77c6db1dbd0e51'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.670984 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3101ab1ab64148bd77c6db1dbd0e51'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.697699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3101ab1ab64148bd77c6db1dbd0e51'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:33.731746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1338/2663] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:33 2022] DELETE /identity/v3/users/1f3101ab1ab64148bd77c6db1dbd0e51 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:33.914020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:33.986251 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:33.989391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:34.120767 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806d175-9998-4ff7-a03f-70279fcd41e6 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:34.217389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:34.218398 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:34.218849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:34.220252 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] PATH_INFO: `/v3/projects/9bb901d58f164b909071a96289a97b01` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:34.222551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb901d58f164b909071a96289a97b01)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:34.225249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:34.396350 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb901d58f164b909071a96289a97b01', 'request_id': 'req-de04255a-f018-4c29-b21a-3115b327b4b0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.403471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb901d58f164b909071a96289a97b01', 'request_id': 'req-de04255a-f018-4c29-b21a-3115b327b4b0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.415739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:34.418604 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:34.434099 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1bdf3-a02f-414d-9c55-30a8a0fc65b3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:34.451547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:34.510746 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb901d58f164b909071a96289a97b01', 'request_id': 'req-de04255a-f018-4c29-b21a-3115b327b4b0'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.516983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:34.517770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:34.518075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:34.518900 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] PATH_INFO: `/v3/projects/dbd8219f9d594e6bb448cd76d76f1503` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:34.520174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd8219f9d594e6bb448cd76d76f1503)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:34.522128 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:34.528810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] The token cache is being invalidate because project 9bb901d58f164b909071a96289a97b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:34.529188 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.529955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-de04255a-f018-4c29-b21a-3115b327b4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.531904 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1326/2664] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:33 2022] DELETE /identity/v3/projects/9bb901d58f164b909071a96289a97b01 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:34.693451 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd8219f9d594e6bb448cd76d76f1503', 'request_id': 'req-bdb5951b-ba33-4f0f-840a-6fb51575f67f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.713037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd8219f9d594e6bb448cd76d76f1503', 'request_id': 'req-bdb5951b-ba33-4f0f-840a-6fb51575f67f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.767458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:34.797538 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd8219f9d594e6bb448cd76d76f1503', 'request_id': 'req-bdb5951b-ba33-4f0f-840a-6fb51575f67f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.823162 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] The token cache is being invalidate because project dbd8219f9d594e6bb448cd76d76f1503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:34.823840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.825120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-bdb5951b-ba33-4f0f-840a-6fb51575f67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:34.828512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1339/2665] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:34 2022] DELETE /identity/v3/projects/dbd8219f9d594e6bb448cd76d76f1503 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:34.839392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:34.839839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:34.840235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:34.864710 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:34.866580 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:34.964443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1327/2666] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:34.973733 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:34.974131 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:34.974783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:34.997553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:35.006503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:35.010022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1340/2667] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:35.018240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.032344 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1418f-09b8-47ce-b96e-b13ff0b7b399 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.039036 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.039677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.039949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.040262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.040967 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:35.041275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.042976 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.057368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1328/2668] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:35.062919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.074531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb912f1-af6e-4b6b-bec2-a85c3ca60b91 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.079896 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.080590 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.081432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.081798 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.082746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.084668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.371499 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1341/2669] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:35 2022] POST /identity/v3/projects => generated 379 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:35.375700 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.387478 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d137ad-ac91-4674-aeef-b845fc1b648e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.456109 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.457176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.457658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.458181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.459332 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.463599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.631978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1329/2670] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:35 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:35.637189 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.654103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e797ec5-3034-488b-bd67-9ad4dd3d7a48 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.660902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.661638 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.661967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.662351 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.663027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.665168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.679606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1342/2671] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:35.683774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.697543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f75ff-0a76-44a2-8002-1646c29c588e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.703058 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.703688 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.703964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.704239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.704909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.706811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f979ba-8ba6-4a95-bb3d-3bcadc739f9d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.720112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1330/2672] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:35.726063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:35.738362 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d64b6-f453-4ea8-a217-3e57f9cbddd8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:35.744192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:35.745054 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.745470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.746024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] PATH_INFO: `/v3/projects/bdf676b98eae4c939fcfb305679b7796/users/0e2d8209a50d4c5db2ace3ba8b06d680/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.764467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf676b98eae4c939fcfb305679b7796, user_id=0e2d8209a50d4c5db2ace3ba8b06d680, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:35.767191 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:35.889501 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1343/2673] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:35 2022] PUT /identity/v3/projects/bdf676b98eae4c939fcfb305679b7796/users/0e2d8209a50d4c5db2ace3ba8b06d680/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:35.901412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:35.902536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:35.902536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:35.950047 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] MFA Rules not processed for user `0e2d8209a50d4c5db2ace3ba8b06d680`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:35.951436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:35.987674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:36.041870 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1331/2674] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:36.048860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:36.124423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:36.145764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0411ab6-35b0-4478-bfbb-df28bbd1bb90 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:36.151221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:36.151989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:36.152366 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:36.152735 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:36.153483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:36.155815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:36.300572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1344/2675] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:36 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:36.307198 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:36.322117 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefd88a-76ab-48f9-8964-671c5c9bcafd None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:36.423623 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:36.424794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:36.426460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:36.426460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:36.427073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:36.429546 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:36.797115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1332/2676] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:36 2022] POST /identity/v3/users => generated 296 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:36.798778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:36.814576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9006a62-e4a6-4dfc-9111-cbd69524ffab admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:36.821842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:36.822879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:36.823048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:36.823439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:36.824166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:36.826082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:36.844495 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1345/2677] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:36.851572 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:36.858582 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f29c48-2827-47fc-ae89-52a03e5adf02 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:36.864455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:36.865214 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:36.865634 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:36.866035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] PATH_INFO: `/v3/projects/d270aa1708e2428ba18a51db3b9e30fe/users/c9bd9b7028c744888e7f28efa7294743/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:36.886325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d270aa1708e2428ba18a51db3b9e30fe, user_id=c9bd9b7028c744888e7f28efa7294743, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:36.889236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:36.992826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:36.995435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.016878 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1333/2678] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:36 2022] PUT /identity/v3/projects/d270aa1708e2428ba18a51db3b9e30fe/users/c9bd9b7028c744888e7f28efa7294743/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:37.023781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a6806-20d9-4435-95bb-88c944385d01 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:37.026544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:37.110789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:37.111728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.112152 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.112619 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] PATH_INFO: `/v3/users/32928ee70cfd4735be06f675ffffa228` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.114395 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32928ee70cfd4735be06f675ffffa228)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:37.116622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:37.132919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16644f69-61db-4a0c-85b7-11a151f3b8ba admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:37.138476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:37.139104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.139383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.139660 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.140315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:37.141980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:37.154175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1334/2679] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:37.167377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:37.180345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534167-bdb1-4f27-8ca0-2d3d94efff28 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:37.185253 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:37.189460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.189460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.189460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] PATH_INFO: `/v3/projects/d270aa1708e2428ba18a51db3b9e30fe/users/c9bd9b7028c744888e7f28efa7294743/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.189460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d270aa1708e2428ba18a51db3b9e30fe, user_id=c9bd9b7028c744888e7f28efa7294743, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:37.192222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d50d06-5783-4ba7-a3b2-446eff674b22 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:37.204071 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1335/2680] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:37 2022] PUT /identity/v3/projects/d270aa1708e2428ba18a51db3b9e30fe/users/c9bd9b7028c744888e7f28efa7294743/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:37.217180 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.240624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.240624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.250780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] MFA Rules not processed for user `c9bd9b7028c744888e7f28efa7294743`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:37.251981 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.265235 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:37.350003 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32928ee70cfd4735be06f675ffffa228'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:37.362118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1336/2681] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:37.374859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:37.376432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.421951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32928ee70cfd4735be06f675ffffa228'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:37.422651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32928ee70cfd4735be06f675ffffa228'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:37.423305 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32928ee70cfd4735be06f675ffffa228'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:37.433770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-72364f7a-15ad-4ed3-a402-e5c6c058cbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32928ee70cfd4735be06f675ffffa228'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:37.453959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1346/2682] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:36 2022] DELETE /identity/v3/users/32928ee70cfd4735be06f675ffffa228 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:37.460115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.460497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.460859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.480831 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfae1b-24b4-4ddf-9d9e-18a5b81d0144 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:37.483987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:37.485290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.522523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:37.561653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:37.562007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1347/2683] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:37.563136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.563819 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.564403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.578879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.579086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:37.579086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:37.635565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:37.638358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:37.652867 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1337/2684] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:37.656123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261279e4-11ff-4f7b-83fa-89f45a8a1495 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:37.663899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:37.665114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:37.665586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:37.666198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:37.688171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:37.692512 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:37.714468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1348/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:38.282270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:38.284681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:38.310587 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934d91-ee79-4dd0-9fa1-97157daf5724 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:38.322325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:38.322325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:38.322325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:38.324638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] PATH_INFO: `/v3/projects/626e717c13094f57bc91e3c080029d89` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:38.325932 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626e717c13094f57bc91e3c080029d89)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:38.331829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:38.353684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:38.707652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626e717c13094f57bc91e3c080029d89', 'request_id': 'req-df63c6d7-2ae1-4d9d-938f-07347e5b4559'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:38.714098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626e717c13094f57bc91e3c080029d89', 'request_id': 'req-df63c6d7-2ae1-4d9d-938f-07347e5b4559'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:38.836336 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626e717c13094f57bc91e3c080029d89', 'request_id': 'req-df63c6d7-2ae1-4d9d-938f-07347e5b4559'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:38.848826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] The token cache is being invalidate because project 626e717c13094f57bc91e3c080029d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:38.849159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:38.849948 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:38.852130 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1338/2686] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:38 2022] DELETE /identity/v3/projects/626e717c13094f57bc91e3c080029d89 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:38.857532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:38.869289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ccc22-2b1f-446c-a04a-925564ade5b1 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:38.960466 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:38.960991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:38.961363 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:38.961631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] PATH_INFO: `/v3/users/6d82a7e39ef84b399eed032f76a8cd7f` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:38.962808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d82a7e39ef84b399eed032f76a8cd7f)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:38.964734 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:39.213692 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d82a7e39ef84b399eed032f76a8cd7f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:39.293653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d82a7e39ef84b399eed032f76a8cd7f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:39.294527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d82a7e39ef84b399eed032f76a8cd7f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:39.295324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d82a7e39ef84b399eed032f76a8cd7f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:39.306063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-68ee0ff3-f0f1-4aba-b8af-5f8465e37ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d82a7e39ef84b399eed032f76a8cd7f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:39.324287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:39.332980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1349/2687] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:38 2022] DELETE /identity/v3/users/6d82a7e39ef84b399eed032f76a8cd7f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:39.847221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:39.849472 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:39.885539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63c6d7-2ae1-4d9d-938f-07347e5b4559 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:39.962024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:39.962676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:39.963020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:39.963305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] PATH_INFO: `/v3/projects/9f5df82f8be14b41ae846d1693ebf25a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:39.964484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5df82f8be14b41ae846d1693ebf25a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:39.966709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.118234 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5df82f8be14b41ae846d1693ebf25a', 'request_id': 'req-4588f9d8-0120-411c-bc41-87705c916c6b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:40.130150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5df82f8be14b41ae846d1693ebf25a', 'request_id': 'req-4588f9d8-0120-411c-bc41-87705c916c6b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:40.208670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5df82f8be14b41ae846d1693ebf25a', 'request_id': 'req-4588f9d8-0120-411c-bc41-87705c916c6b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:40.223917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] The token cache is being invalidate because project 9f5df82f8be14b41ae846d1693ebf25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:40.224224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:40.224936 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-4588f9d8-0120-411c-bc41-87705c916c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:40.226497 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1339/2688] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:39 2022] DELETE /identity/v3/projects/9f5df82f8be14b41ae846d1693ebf25a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:40.231676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.232457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.232457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.260028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:40.262067 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:40.345640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1350/2689] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:40.354652 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.354919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.355202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.386078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:40.387221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:40.395766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1340/2690] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:40.400838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.413037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27488874-5b46-4eb6-a6b0-1caefb64ad7a None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.417789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.418442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.418746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.419017 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.419674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:40.419977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.421600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.435476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1351/2691] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:40.443005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.452518 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9132-6e33-4e7c-a1a6-e28d9f65b7b6 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.457220 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.457833 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.458142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.458411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.459307 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.461217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.584585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:40.600542 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1341/2692] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:40 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:40.602516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.613432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bddda-0a6b-4fc1-b85b-7d36117e54f8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.697434 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.698602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.699239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.699943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.701376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.706524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.799859 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1352/2693] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:40 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:40.805014 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.815911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ac5e-03a9-43a0-bff3-c5ea91e3a4fa admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.825087 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.826093 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.826407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.826678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.827325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.828963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.841066 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1342/2694] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:40.848959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.859057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413966-2085-45a4-8392-86ce9ca3cf7a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.865762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.866802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.867211 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.867663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.868844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.872673 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:40.889294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1353/2695] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:40.895346 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.915387 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2e2e9-cc88-4ec1-89f7-183fa0c2ce18 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:40.924327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:40.925427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:40.925927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:40.926399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] PATH_INFO: `/v3/projects/628068500ca74f149c179ade60a252c4/users/d5379d6d5d634bb5a178baf2d5ce351c/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:40.945024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:40.947429 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:40.948861 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=628068500ca74f149c179ade60a252c4, user_id=d5379d6d5d634bb5a178baf2d5ce351c, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:40.951934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86b5f2-857b-4f0a-9b6b-b8e101a13dfc admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.022754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523449e-172b-4ece-a486-7e48423f67d6 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.031509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1343/2696] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:40 2022] PUT /identity/v3/projects/628068500ca74f149c179ade60a252c4/users/d5379d6d5d634bb5a178baf2d5ce351c/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:41.045092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.045562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.045848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.055077 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:41.083914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] MFA Rules not processed for user `d5379d6d5d634bb5a178baf2d5ce351c`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:41.085310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:41.113212 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.114111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.118006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.118006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.118006 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:41.183457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1344/2697] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:41.188264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:41.204322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.205832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.223264 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1354/2698] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:41.276640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9580f-4179-4e80-9d7d-d0437b4f8c13 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.281669 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.282358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.282659 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.282925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.283679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.286400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.378990 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1345/2699] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:41 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:41.383603 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:41.395328 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e73bc8-3d16-4b90-ba19-9935a7831942 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.472166 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.472874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.479031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.479031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.479031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.479031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.568707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1355/2700] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:41 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:41.572889 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:41.584795 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac374b-215f-4196-8165-beeb1f8979d2 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.589654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.590297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.590575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.590844 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.591747 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.593391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.604929 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1346/2701] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:41.610738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:41.621524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95786c69-81e7-4605-9dd2-dd02307a3fae admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.626276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.626868 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.627146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.627415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.628844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.630468 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5705e-bd12-48d6-bd91-7f047ed42940 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.641001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1356/2702] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:41.645791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:41.660085 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccbad-6098-43e5-a4e8-6ce03d5f4b87 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:41.667270 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:41.667959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.668238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.668512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] PATH_INFO: `/v3/projects/ff1aec02d15a48da92bf1b32ca5e4607/users/656db2f30cb84a539db314ac40412bc2/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.814065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1aec02d15a48da92bf1b32ca5e4607, user_id=656db2f30cb84a539db314ac40412bc2, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:41.816803 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:41.948910 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1347/2703] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:41 2022] PUT /identity/v3/projects/ff1aec02d15a48da92bf1b32ca5e4607/users/656db2f30cb84a539db314ac40412bc2/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:41.960453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:41.960699 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:41.960909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:41.993532 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] MFA Rules not processed for user `656db2f30cb84a539db314ac40412bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:41.994945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:42.045348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.072791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1357/2704] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:42.077655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.085035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.162060 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9819c02-4d67-4cbe-93a6-679513ee8bf7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.167100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.167716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.168003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.168269 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.169090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.171102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.284782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1348/2705] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:42 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:42.289631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.303943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209246f-60d5-4902-bdae-c0a1b57b49af None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.384233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.385631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.385631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.385631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.386270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.388084 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.485535 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1358/2706] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:42 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:42.490292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.501417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fec823-2d5f-4267-adce-26f50c5a1413 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.506933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.507557 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.507835 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.508098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.508753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.510447 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.522772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1349/2707] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:42.527486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.541623 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdda12-a36e-4c75-9196-6005c3e7d2f2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.547081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.547602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.547879 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.548160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] PATH_INFO: `/v3/projects/1ede90cd6c6541c4836c562517031c02/users/bb965e38dda943c0ababf7d99cdad496/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.567737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ede90cd6c6541c4836c562517031c02, user_id=bb965e38dda943c0ababf7d99cdad496, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.570550 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.691938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1359/2708] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:42 2022] PUT /identity/v3/projects/1ede90cd6c6541c4836c562517031c02/users/bb965e38dda943c0ababf7d99cdad496/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:42.696714 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.708974 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb8d80-6bc0-4762-a6ae-94ac99be3443 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.782732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.783443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.783743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.784008 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.785097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.786957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba810bf-2688-4aae-968c-1119fa4bc313 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.797725 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1350/2709] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:42.803098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:42.814200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5025-aee9-488a-9e10-ec86b34892b5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:42.820384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:42.821105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.821496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.821739 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] PATH_INFO: `/v3/projects/1ede90cd6c6541c4836c562517031c02/users/bb965e38dda943c0ababf7d99cdad496/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.823878 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ede90cd6c6541c4836c562517031c02, user_id=bb965e38dda943c0ababf7d99cdad496, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:42.826492 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:42.838992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1360/2710] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:42 2022] PUT /identity/v3/projects/1ede90cd6c6541c4836c562517031c02/users/bb965e38dda943c0ababf7d99cdad496/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:42.865731 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:42.866334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:42.866334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:42.895902 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] MFA Rules not processed for user `bb965e38dda943c0ababf7d99cdad496`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:42.900813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:42.967337 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.971166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1351/2711] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:43.283278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:43.357960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d729c62-14c9-4048-8b5e-a8090a19449a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:43.361665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:43.362333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:43.362613 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:43.362885 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:43.372951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:43.374472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:43.385695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1361/2712] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:44.766355 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:44.768129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:44.780927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b90bb-7c27-41cf-a9b4-f3dbafe8e125 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:44.784997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:44.786084 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:44.792687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:44.792687 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:44.855899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:44.857411 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9559d-9e05-48f0-aeb9-46bde8683a7f service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:44.868286 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1352/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:45.941096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:45.942566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:45.977521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:46.008283 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a813-fcf2-4ddf-8c56-7ba43d50bcfd service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:46.013410 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:46.023716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:46.023716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:46.023716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] PATH_INFO: `/v3/users/0e2d8209a50d4c5db2ace3ba8b06d680` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:46.023716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2d8209a50d4c5db2ace3ba8b06d680)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:46.023716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:46.187777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2d8209a50d4c5db2ace3ba8b06d680'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:46.282210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2d8209a50d4c5db2ace3ba8b06d680'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:46.282332 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2d8209a50d4c5db2ace3ba8b06d680'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:46.282874 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2d8209a50d4c5db2ace3ba8b06d680'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:46.292217 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2d8209a50d4c5db2ace3ba8b06d680'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:46.310243 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1362/2714] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:45 2022] DELETE /identity/v3/users/0e2d8209a50d4c5db2ace3ba8b06d680 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:46.314677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:46.315166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:46.315655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:46.334238 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:46.335436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:46.399636 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1353/2715] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:46.410219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:46.412200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:46.470676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a272c03-8771-4462-b733-ea5dab096571 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:46.474994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:46.475508 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:46.475781 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:46.476045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:46.485346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:46.487443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:46.497405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1363/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:47.024839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:47.026709 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:47.039457 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01619db5-1359-454e-8abc-efc97ca0697e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:47.044766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:47.045427 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:47.047885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:47.047885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] PATH_INFO: `/v3/projects/bdf676b98eae4c939fcfb305679b7796` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:47.047885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf676b98eae4c939fcfb305679b7796)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:47.049851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:47.192182 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf676b98eae4c939fcfb305679b7796', 'request_id': 'req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.198805 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf676b98eae4c939fcfb305679b7796', 'request_id': 'req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.285136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf676b98eae4c939fcfb305679b7796', 'request_id': 'req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.297112 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] The token cache is being invalidate because project bdf676b98eae4c939fcfb305679b7796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:47.297373 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.298091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.300136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1354/2717] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:47 2022] DELETE /identity/v3/projects/bdf676b98eae4c939fcfb305679b7796 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:47.304376 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:47.314225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688335-4714-4826-8f7a-f12b03a8ab0e service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:47.367195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:47.379476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:47.380219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:47.380523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:47.380759 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] PATH_INFO: `/v3/users/c9bd9b7028c744888e7f28efa7294743` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:47.381990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bd9b7028c744888e7f28efa7294743)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:47.383963 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:47.626911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bd9b7028c744888e7f28efa7294743'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.739979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bd9b7028c744888e7f28efa7294743'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.742063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bd9b7028c744888e7f28efa7294743'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.742063 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bd9b7028c744888e7f28efa7294743'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.750368 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-55eedc14-b81a-41b2-af62-cc700f4c9cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bd9b7028c744888e7f28efa7294743'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:47.770808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1364/2718] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:47 2022] DELETE /identity/v3/users/c9bd9b7028c744888e7f28efa7294743 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:48.346765 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:48.349134 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:48.366501 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7f8bf-ae1f-4627-ab28-3ad1a7845c7b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:48.391742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:48.431624 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:48.432263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.432533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.432806 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] PATH_INFO: `/v3/projects/d270aa1708e2428ba18a51db3b9e30fe` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.434024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d270aa1708e2428ba18a51db3b9e30fe)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:48.435935 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:48.578375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd270aa1708e2428ba18a51db3b9e30fe', 'request_id': 'req-353e5421-7a5e-4018-9eab-0a039ee16a41'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.585684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd270aa1708e2428ba18a51db3b9e30fe', 'request_id': 'req-353e5421-7a5e-4018-9eab-0a039ee16a41'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.662142 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd270aa1708e2428ba18a51db3b9e30fe', 'request_id': 'req-353e5421-7a5e-4018-9eab-0a039ee16a41'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.677545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] The token cache is being invalidate because project d270aa1708e2428ba18a51db3b9e30fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:48.678494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.679192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-353e5421-7a5e-4018-9eab-0a039ee16a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:48.681949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1355/2719] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:48 2022] DELETE /identity/v3/projects/d270aa1708e2428ba18a51db3b9e30fe => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:48.689450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.690001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.690453 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.724416 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:48.725708 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:48.804293 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1365/2720] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:48.812924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.813227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.819782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.836599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:48.837830 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:48.846187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1356/2721] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:48.850958 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:48.860894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9efee-f711-405a-ba62-1c5e06b80bcf None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:48.866334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:48.866888 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.867161 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.867430 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.868089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:48.868384 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:48.870026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:48.883223 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1366/2722] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:48.888576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:48.898969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888455c-5918-4eaa-8bd4-8751b8a88dd4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:48.904009 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:48.904622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:48.904895 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:48.905157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:48.905784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:48.907696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.046614 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1357/2723] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:48 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:49.052036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.062937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa00fd7-217f-4cb7-8382-9bb95c970fd3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.136000 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.136737 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.136939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.137164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.137802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.139793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.149690 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:49.251749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1367/2724] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:49 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:49.257126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.276856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03159-5561-4dc2-b206-2e00453d56e9 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.282227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.282970 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.283310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.283593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.284899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.287653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.309919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1358/2725] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:49.312009 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.327367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43132dd-e79c-4ec4-8529-81d4844c458d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.334154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.334980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.335322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.335754 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.336908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.338772 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf905b-585b-4c67-85a6-687f08c58b5c admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.353994 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1368/2726] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:49.359894 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.371409 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fa0ad-815d-46e3-bbb1-d383a9253c46 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.376775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.381606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.381606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.381606 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] PATH_INFO: `/v3/projects/b18eb49826cd459581844ffa3fc5aeb7/users/9d209fd958f242f39f2aea2705b86220/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.400055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18eb49826cd459581844ffa3fc5aeb7, user_id=9d209fd958f242f39f2aea2705b86220, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.403822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.533983 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1359/2727] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:49 2022] PUT /identity/v3/projects/b18eb49826cd459581844ffa3fc5aeb7/users/9d209fd958f242f39f2aea2705b86220/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:49.546545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.546812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.547179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.579380 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] MFA Rules not processed for user `9d209fd958f242f39f2aea2705b86220`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:49.580719 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:49.685127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1369/2728] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:49.689800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.763059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:49.777303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f577af2-93f5-4200-b6b2-65f72e8f5b9d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.782856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.783491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.783899 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.784183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.784955 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.786947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:49.901946 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1360/2729] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:49 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:49.906078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:49.918343 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f023-b4fc-45fd-b690-9cf3162a6db0 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:49.990898 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:49.991531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:49.991813 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:49.992087 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:49.992722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:49.994753 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.124184 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1370/2730] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:49 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:32:50.129165 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.139854 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f673e-20fb-46de-9daf-81ebfdc631fb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.152257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.152927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.153285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.153626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.154407 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.156151 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.169292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1361/2731] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:50.173595 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.185105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533aa06-a5d1-4b7b-afb6-7ca25d31fe37 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.190296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.191022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.191338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.191586 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] PATH_INFO: `/v3/projects/2e5640ec7c18495c9190601ce1a95c1f/users/3aac6a1f8c07461884426b84dbda9dee/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.210713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5640ec7c18495c9190601ce1a95c1f, user_id=3aac6a1f8c07461884426b84dbda9dee, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.213555 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.368527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1371/2732] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:50 2022] PUT /identity/v3/projects/2e5640ec7c18495c9190601ce1a95c1f/users/3aac6a1f8c07461884426b84dbda9dee/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:50.373248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.387435 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672976d-6d4f-4f1a-93f6-b563d08acfdd admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.447394 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.448005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.448290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.448561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.449208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.450848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8beb14-95de-4bd3-9882-175f8f93f0db admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.461303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1362/2733] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:50.465598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.476838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542d44f-fa0f-4cec-a3bb-2bf9f1a3b618 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.485374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.485374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.485374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.485374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] PATH_INFO: `/v3/projects/2e5640ec7c18495c9190601ce1a95c1f/users/3aac6a1f8c07461884426b84dbda9dee/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.485852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5640ec7c18495c9190601ce1a95c1f, user_id=3aac6a1f8c07461884426b84dbda9dee, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.487330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.498914 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1372/2734] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:50 2022] PUT /identity/v3/projects/2e5640ec7c18495c9190601ce1a95c1f/users/3aac6a1f8c07461884426b84dbda9dee/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:50.510293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.510586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.510890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.542719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] MFA Rules not processed for user `3aac6a1f8c07461884426b84dbda9dee`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:50.543959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:50.613547 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1363/2735] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:50.625658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.627397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:50.657038 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:50.702174 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2fc8a-eb05-41ca-922d-c064389d1ef7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.707806 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.708694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.708977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.709254 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.730221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.731750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba81540-98fa-4f61-8676-a405634679c8 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:50.743288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1373/2736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:50.869992 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:50.920488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:50.940399 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b3ee-d3f2-4404-aa18-9e60454b45db None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:50.945477 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:50.946160 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:50.946439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:50.946711 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] PATH_INFO: `/v3/users/9d209fd958f242f39f2aea2705b86220` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:50.947913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d209fd958f242f39f2aea2705b86220)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:50.949859 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:51.216811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d209fd958f242f39f2aea2705b86220'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:51.327734 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d209fd958f242f39f2aea2705b86220'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:51.328354 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d209fd958f242f39f2aea2705b86220'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:51.328982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d209fd958f242f39f2aea2705b86220'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:51.337153 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d209fd958f242f39f2aea2705b86220'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:51.356001 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1364/2737] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:50 2022] DELETE /identity/v3/users/9d209fd958f242f39f2aea2705b86220 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:51.360524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:51.361081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:51.361081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:51.380198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:51.381397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:51.449795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1374/2738] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:51.460247 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:51.461943 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:51.526959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d442fe-9ec7-4d08-9dab-a5cccc07014e admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:51.530589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:51.531205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:51.531484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:51.531756 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:51.543092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:51.544315 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:51.556219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1365/2739] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:51.992770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:51.994287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:52.006632 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d908c-4c5c-4af8-aac2-8d8d312145a2 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:52.011338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:52.012052 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:52.012255 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:52.012525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] PATH_INFO: `/v3/projects/b18eb49826cd459581844ffa3fc5aeb7` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:52.013688 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18eb49826cd459581844ffa3fc5aeb7)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:52.015652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:52.151953 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18eb49826cd459581844ffa3fc5aeb7', 'request_id': 'req-615d9f97-8bce-4158-92fb-6e551f013d0f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.158802 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18eb49826cd459581844ffa3fc5aeb7', 'request_id': 'req-615d9f97-8bce-4158-92fb-6e551f013d0f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.233200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18eb49826cd459581844ffa3fc5aeb7', 'request_id': 'req-615d9f97-8bce-4158-92fb-6e551f013d0f'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.248752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] The token cache is being invalidate because project b18eb49826cd459581844ffa3fc5aeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:52.249178 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.250190 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.252695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1375/2740] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:51 2022] DELETE /identity/v3/projects/b18eb49826cd459581844ffa3fc5aeb7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:52.258176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:52.270040 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e3fd8-6fbe-4a4c-8d71-e8cdd56eda7c service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:52.355603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:52.356248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:52.356530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:52.356811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] PATH_INFO: `/v3/users/3aac6a1f8c07461884426b84dbda9dee` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:52.358266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aac6a1f8c07461884426b84dbda9dee)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:52.360366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:52.369293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:52.635709 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:52.637413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:52.663045 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aac6a1f8c07461884426b84dbda9dee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.697263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:52.700976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d9f97-8bce-4158-92fb-6e551f013d0f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:52.705007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:52.705664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:52.705971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:52.706836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:52.708989 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:52.768090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:52.770096 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:52.778983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1376/2741] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:52.815816 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aac6a1f8c07461884426b84dbda9dee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.816708 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aac6a1f8c07461884426b84dbda9dee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.817404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aac6a1f8c07461884426b84dbda9dee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.824842 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b3cd4b09-2b7c-4623-9e9e-e4ea4b3d3e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aac6a1f8c07461884426b84dbda9dee'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:52.851536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1366/2742] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:52 2022] DELETE /identity/v3/users/3aac6a1f8c07461884426b84dbda9dee => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:53.372652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:53.374577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:53.401250 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232fa8-62c6-40a7-b069-d33e5dbba757 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:53.466723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:53.467258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:53.467531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:53.467800 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] PATH_INFO: `/v3/projects/2e5640ec7c18495c9190601ce1a95c1f` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:53.468949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5640ec7c18495c9190601ce1a95c1f)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:53.470892 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:53.649312 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5640ec7c18495c9190601ce1a95c1f', 'request_id': 'req-24b4d11b-518b-48ad-9a8b-cfce57375e89'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:53.662079 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5640ec7c18495c9190601ce1a95c1f', 'request_id': 'req-24b4d11b-518b-48ad-9a8b-cfce57375e89'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:53.782338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5640ec7c18495c9190601ce1a95c1f', 'request_id': 'req-24b4d11b-518b-48ad-9a8b-cfce57375e89'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:53.794007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] The token cache is being invalidate because project 2e5640ec7c18495c9190601ce1a95c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:53.794297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:53.794999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-24b4d11b-518b-48ad-9a8b-cfce57375e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:53.796662 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1377/2743] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:53 2022] DELETE /identity/v3/projects/2e5640ec7c18495c9190601ce1a95c1f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:53.802390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:53.802888 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:53.803033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:53.826013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:53.826443 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:53.888599 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1367/2744] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:53.897634 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:53.897950 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:53.898226 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:53.919981 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:53.921237 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:53.929587 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1378/2745] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:53.934671 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:53.947674 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2e805-c12e-4eae-9a64-7c77272cb03c None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:53.952717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:53.953363 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:53.953643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:53.953949 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:53.954615 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:32:53.954917 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:53.956637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:53.970163 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1368/2746] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:32:53.975757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:53.985610 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becc36c-2eb4-4ae5-8de0-7f687c81578f None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:53.991575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:53.992393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:53.992768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:53.993180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:53.993938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:53.996213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.181194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1379/2747] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:53 2022] POST /identity/v3/projects => generated 393 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:54.185784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:54.196202 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853eafb-89b1-4463-956a-cc427c9e5c2a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:54.254539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:54.255175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.255455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.255726 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.256349 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:54.258372 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.388122 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1369/2748] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:54 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:54.392241 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:54.399857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:54.403880 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191de51-e665-4192-a5ba-faf793210268 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:54.408437 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:54.409039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.410013 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.410467 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.411118 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:54.412716 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.423389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1380/2749] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:54.431522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:54.436596 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:54.442637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794889f9-3f35-4997-9d85-090da8895568 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:54.448237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:54.448871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.449150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.449421 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.450104 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:54.451740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e324680-bc43-4e44-91bb-3455b6c99098 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.462512 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1370/2750] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:54.467235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:54.479069 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73caff9-962d-4e2b-adc7-19b942f2137e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:54.483810 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:54.491674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.491674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.491674 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] PATH_INFO: `/v3/projects/43ee32867d6c438a9dba04a7f2b1af17/users/31a0ad43ffbd44d0bb1427108e83fe98/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.501139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ee32867d6c438a9dba04a7f2b1af17, user_id=31a0ad43ffbd44d0bb1427108e83fe98, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:54.504257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.582689 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1381/2751] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:54 2022] PUT /identity/v3/projects/43ee32867d6c438a9dba04a7f2b1af17/users/31a0ad43ffbd44d0bb1427108e83fe98/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:54.653852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532b86-f719-47b3-b239-c6646703f14f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.654167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532b86-f719-47b3-b239-c6646703f14f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.654444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84532b86-f719-47b3-b239-c6646703f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.684464 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-84532b86-f719-47b3-b239-c6646703f14f None None] MFA Rules not processed for user `31a0ad43ffbd44d0bb1427108e83fe98`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:54.685576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-84532b86-f719-47b3-b239-c6646703f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:54.766650 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1371/2752] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:54.772021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:54.865593 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8fc5a-ddc6-41de-842c-d02106c2f7b8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:54.870372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:54.870987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:54.871262 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:54.871529 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:54.872179 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:54.874126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:54.987864 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1382/2753] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:32:54 2022] POST /identity/v3/projects => generated 391 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:54.993519 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84532b86-f719-47b3-b239-c6646703f14f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.004357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84532b86-f719-47b3-b239-c6646703f14f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.068716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.069324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.069604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.069905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.070550 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.072533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.176817 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1372/2754] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:32:54 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:32:55.181334 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.193472 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350be7b-c761-4273-bedd-7edb000a430b admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.198246 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.198911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.199194 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.199465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.200114 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.201722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.213811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1383/2755] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:32:55.218850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.231498 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630f61-a1d2-45bf-b1fc-ed37fa6df131 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.236325 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.236995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.237284 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.237598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] PATH_INFO: `/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481/users/f28389ff76f24c1390660d657e7a5976/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.256377 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba1d36cb9fa4795ba4cc27d56ca0481, user_id=f28389ff76f24c1390660d657e7a5976, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.259079 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.368077 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1373/2756] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:55 2022] PUT /identity/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481/users/f28389ff76f24c1390660d657e7a5976/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:55.372193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.383253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a426c-7716-4d7f-8bd6-23060b5b686e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.451278 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.451895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.452176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.452483 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.453139 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.454791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d24c4f-438c-4361-9b83-2305efe882e1 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.466319 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1384/2757] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:32:55.472205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.483208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be179e-2719-43b5-9e6c-c01f67506485 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.488203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.488828 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.489102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.489368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] PATH_INFO: `/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481/users/f28389ff76f24c1390660d657e7a5976/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.491455 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba1d36cb9fa4795ba4cc27d56ca0481, user_id=f28389ff76f24c1390660d657e7a5976, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.494119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.505901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1374/2758] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:32:55 2022] PUT /identity/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481/users/f28389ff76f24c1390660d657e7a5976/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:55.517307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.517771 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.518361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.551601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] MFA Rules not processed for user `f28389ff76f24c1390660d657e7a5976`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:55.553703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:55.585615 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:55.628770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1385/2759] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:32:55.639863 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.641563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:55.682345 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:55.710413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca777912-3d78-4fb2-bad9-373adef82b62 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.714263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.714875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.715152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.715425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.726681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.728224 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.739986 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1375/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:55.791267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:55.803101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6712d-5c7d-4a62-bd44-78a0bc9ce9b8 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:55.806909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:55.807521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:55.807795 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:55.808064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:55.868183 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:55.869631 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:55.880913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1386/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:58.074829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:58.076241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.152088 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca7ea-e505-4e33-8905-90151af3f4a4 service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:58.156658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:58.157285 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.157597 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.157868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] PATH_INFO: `/v3/users/d5379d6d5d634bb5a178baf2d5ce351c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.159017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5379d6d5d634bb5a178baf2d5ce351c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:58.161007 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:58.264536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:58.266102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.289021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072414a8-3a71-4238-ad08-3501822102ca service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:58.289942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:58.290621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.290901 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.291175 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] PATH_INFO: `/v3/users/b6167145d9704b79b513305428016264` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.292952 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6167145d9704b79b513305428016264)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:58.295014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:58.438620 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5379d6d5d634bb5a178baf2d5ce351c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.559574 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5379d6d5d634bb5a178baf2d5ce351c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.560139 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5379d6d5d634bb5a178baf2d5ce351c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.560796 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5379d6d5d634bb5a178baf2d5ce351c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.571193 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-98668b1b-b389-4488-b808-4c063a99c2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5379d6d5d634bb5a178baf2d5ce351c'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.592025 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1376/2762] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:58 2022] DELETE /identity/v3/users/d5379d6d5d634bb5a178baf2d5ce351c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:58.597400 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.597840 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.598144 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.618304 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:58.619551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.627173 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6167145d9704b79b513305428016264'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.678905 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:58.692907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1377/2763] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:58.703858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:58.706691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.736789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6167145d9704b79b513305428016264'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.738849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6167145d9704b79b513305428016264'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.739930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6167145d9704b79b513305428016264'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.760228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-86106e54-e42f-4d6b-aebe-fa964f69e4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6167145d9704b79b513305428016264'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:58.791498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1387/2764] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:58 2022] DELETE /identity/v3/users/b6167145d9704b79b513305428016264 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:32:58.800540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee44f9f-3baf-49b3-acec-97f5cc5e90f3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:58.804936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.805316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.805823 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.836089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:32:58.837549 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.868231 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:58.869271 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.869653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.870124 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.872528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.877021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:58.910659 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1388/2765] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:32:58.930884 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:58.932497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:58.947171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa95b-c8b5-46c7-8594-56114ae8cbdb None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:58.953497 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:58.954598 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:58.955100 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:58.955536 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:58.958752 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:58.960909 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:58.972811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1378/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:32:58.973860 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:58.975676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:58.989560 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1389/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:32:59.598451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:59.601137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:59.620316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a1a94-c92e-4cb1-b213-f4b3f8824285 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:59.626941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:59.628403 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:59.628807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:59.629329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] PATH_INFO: `/v3/projects/628068500ca74f149c179ade60a252c4` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:59.630810 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628068500ca74f149c179ade60a252c4)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:59.633484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:59.728431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:59.729938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:59.748789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecdfcc-6d30-4dee-8bfb-b0744e7eb48f service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:32:59.756844 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:32:59.757511 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:32:59.757791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:32:59.758294 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] PATH_INFO: `/v3/projects/73595ab2d2364d89b440caeb67ce0dfc` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:32:59.759563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=73595ab2d2364d89b440caeb67ce0dfc)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:32:59.761661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:32:59.782685 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628068500ca74f149c179ade60a252c4', 'request_id': 'req-9f55dffb-874c-4998-8171-37957c740411'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.789779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628068500ca74f149c179ade60a252c4', 'request_id': 'req-9f55dffb-874c-4998-8171-37957c740411'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.792609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:59.904996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628068500ca74f149c179ade60a252c4', 'request_id': 'req-9f55dffb-874c-4998-8171-37957c740411'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.922989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] The token cache is being invalidate because project 628068500ca74f149c179ade60a252c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:32:59.923293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.924030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.926919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1379/2768] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:59 2022] DELETE /identity/v3/projects/628068500ca74f149c179ade60a252c4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:32:59.930887 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:32:59.932533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:32:59.936891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73595ab2d2364d89b440caeb67ce0dfc', 'request_id': 'req-f180062c-5cff-4f36-a5c7-f30efa565cba'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:32:59.948007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73595ab2d2364d89b440caeb67ce0dfc', 'request_id': 'req-f180062c-5cff-4f36-a5c7-f30efa565cba'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.021893 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55dffb-874c-4998-8171-37957c740411 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.085101 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.085751 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.086126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.086402 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] PATH_INFO: `/v3/users/656db2f30cb84a539db314ac40412bc2` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.087584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] RBAC: Authorizing `identity:delete_user(user_id=656db2f30cb84a539db314ac40412bc2)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.089515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.104915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73595ab2d2364d89b440caeb67ce0dfc', 'request_id': 'req-f180062c-5cff-4f36-a5c7-f30efa565cba'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.118214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] The token cache is being invalidate because project 73595ab2d2364d89b440caeb67ce0dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:00.118523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.119170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-f180062c-5cff-4f36-a5c7-f30efa565cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.121059 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1390/2769] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:32:59 2022] DELETE /identity/v3/projects/73595ab2d2364d89b440caeb67ce0dfc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:00.129164 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7489-c7a0-4f03-9cd5-3a620b49f8ac None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.129488 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7489-c7a0-4f03-9cd5-3a620b49f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.129723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d7489-c7a0-4f03-9cd5-3a620b49f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.151591 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-189d7489-c7a0-4f03-9cd5-3a620b49f8ac None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:00.152855 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-189d7489-c7a0-4f03-9cd5-3a620b49f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:00.161866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1391/2770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:00.170018 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.170324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.170752 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.192477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:00.193726 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:00.201861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1392/2771] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:00.206676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.216480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb406cc8-c88e-4bea-b33b-ec162f986730 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.221231 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.221956 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.222236 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.222510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.223156 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:00.223461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.225090 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.238856 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1393/2772] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:33:00.243629 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.258347 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76dde0-3a1f-4e7f-ba94-dea145be87b8 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.264058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.265105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.265633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.265927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.266822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.268938 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.321003 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656db2f30cb84a539db314ac40412bc2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.406519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1394/2773] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:00 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:00.411947 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.431914 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656db2f30cb84a539db314ac40412bc2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.436635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656db2f30cb84a539db314ac40412bc2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.436635 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656db2f30cb84a539db314ac40412bc2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.442922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656db2f30cb84a539db314ac40412bc2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:00.462965 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1380/2774] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:32:59 2022] DELETE /identity/v3/users/656db2f30cb84a539db314ac40412bc2 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:00.486840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:00.492889 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f930a7-b277-44a4-9f1a-2caf7fb4d91d admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.594965 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.596028 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.596572 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.597113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.598476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.602387 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.731666 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1395/2775] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:00 2022] POST /identity/v3/users => generated 282 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:00.736925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.738926 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:00.752223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26b85e-f1c9-4c1b-8565-c39f9811140f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.758321 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.758938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.759215 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.759482 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.760125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.761745 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.773317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1381/2776] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:00.779518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.791577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0fac-0771-42b2-b27e-3140f1c30d84 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.797621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.798286 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.798624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.798922 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.800108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.802022 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ac797-cc9c-44c6-b1f0-61a572ea83d7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.812720 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1396/2777] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:00.817702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.828194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8208d-4e10-47de-840e-b2f1bfdf4669 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:00.834081 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:00.834330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.834533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.834786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] PATH_INFO: `/v3/projects/534984c650c94425a0a6c03e9c710bdc/users/851e3d9f3c32458f97d4583c03c453e2/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.856056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534984c650c94425a0a6c03e9c710bdc, user_id=851e3d9f3c32458f97d4583c03c453e2, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:00.861105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:00.946843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1382/2778] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:00 2022] PUT /identity/v3/projects/534984c650c94425a0a6c03e9c710bdc/users/851e3d9f3c32458f97d4583c03c453e2/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:00.958566 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:00.958850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:00.959127 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:00.977851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:00.980293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:01.013976 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] MFA Rules not processed for user `851e3d9f3c32458f97d4583c03c453e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:01.016007 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:01.052973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:01.085839 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a3844-7944-422c-8546-d52e311cc7c8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:01.090591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:01.091488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:01.091797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:01.092032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] PATH_INFO: `/v3/projects/ff1aec02d15a48da92bf1b32ca5e4607` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:01.093167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1aec02d15a48da92bf1b32ca5e4607)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:01.095102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:01.108701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1397/2779] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:01.120710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:01.122163 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:01.187240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ab1e-f69f-4be8-8d85-e7d7b107e4c3 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:01.194579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:01.195214 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:01.195493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:01.195847 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:01.211192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:01.211192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:01.218493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1398/2780] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:33:01.272116 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1aec02d15a48da92bf1b32ca5e4607', 'request_id': 'req-271fbfb7-8c15-404a-b29f-19f1ffba1806'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.278585 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1aec02d15a48da92bf1b32ca5e4607', 'request_id': 'req-271fbfb7-8c15-404a-b29f-19f1ffba1806'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.358963 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1aec02d15a48da92bf1b32ca5e4607', 'request_id': 'req-271fbfb7-8c15-404a-b29f-19f1ffba1806'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.370417 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] The token cache is being invalidate because project ff1aec02d15a48da92bf1b32ca5e4607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:01.370706 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.371391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.372884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1383/2781] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:00 2022] DELETE /identity/v3/projects/ff1aec02d15a48da92bf1b32ca5e4607 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:01.376979 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:01.388902 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383fd34-2c69-4b50-9f5b-e735f3143618 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:01.401698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:01.449081 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:01.449725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:01.450039 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:01.450314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] PATH_INFO: `/v3/users/bb965e38dda943c0ababf7d99cdad496` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:01.451471 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb965e38dda943c0ababf7d99cdad496)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:01.453394 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:01.670502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb965e38dda943c0ababf7d99cdad496'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.770669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb965e38dda943c0ababf7d99cdad496'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.771663 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb965e38dda943c0ababf7d99cdad496'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.772287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb965e38dda943c0ababf7d99cdad496'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.779768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb965e38dda943c0ababf7d99cdad496'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:01.797316 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1399/2782] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:01 2022] DELETE /identity/v3/users/bb965e38dda943c0ababf7d99cdad496 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:02.333056 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:02.335576 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.355179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbfb7-8c15-404a-b29f-19f1ffba1806 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:02.415059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:02.415696 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.415978 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.416266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] PATH_INFO: `/v3/projects/1ede90cd6c6541c4836c562517031c02` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.417346 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:02.417471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ede90cd6c6541c4836c562517031c02)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:02.418919 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.419299 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:02.428703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:02.432840 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694438a9-b7db-4efb-aee4-d64c40bbaa41 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:02.437831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:02.438502 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.438816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.439284 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] PATH_INFO: `/v3/users/31a0ad43ffbd44d0bb1427108e83fe98` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.441025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a0ad43ffbd44d0bb1427108e83fe98)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:02.442992 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:02.547969 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ede90cd6c6541c4836c562517031c02', 'request_id': 'req-b60ac5aa-1792-4077-85a6-4980265f8f62'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.554781 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ede90cd6c6541c4836c562517031c02', 'request_id': 'req-b60ac5aa-1792-4077-85a6-4980265f8f62'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.655995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ede90cd6c6541c4836c562517031c02', 'request_id': 'req-b60ac5aa-1792-4077-85a6-4980265f8f62'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.667368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] The token cache is being invalidate because project 1ede90cd6c6541c4836c562517031c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:02.667663 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.668291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-b60ac5aa-1792-4077-85a6-4980265f8f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.669802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1384/2783] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:02 2022] DELETE /identity/v3/projects/1ede90cd6c6541c4836c562517031c02 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:02.676136 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097f70-abea-450a-aab1-8dded3cb9eb2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.676422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097f70-abea-450a-aab1-8dded3cb9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.676694 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae097f70-abea-450a-aab1-8dded3cb9eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.698197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-ae097f70-abea-450a-aab1-8dded3cb9eb2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:02.699415 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-ae097f70-abea-450a-aab1-8dded3cb9eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.699537 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a0ad43ffbd44d0bb1427108e83fe98'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.757851 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1385/2784] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:02.766167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.766454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.766722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.784717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a0ad43ffbd44d0bb1427108e83fe98'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.785575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a0ad43ffbd44d0bb1427108e83fe98'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.786448 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a0ad43ffbd44d0bb1427108e83fe98'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.787450 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:02.788658 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.794275 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1a02a373-f1b5-4324-80b2-ace8474728af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a0ad43ffbd44d0bb1427108e83fe98'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:02.797024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1386/2785] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:02.801655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:02.810759 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e27acd-db2f-44f1-8766-4573bbffc04f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:02.812393 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1400/2786] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:02 2022] DELETE /identity/v3/users/31a0ad43ffbd44d0bb1427108e83fe98 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:02.816729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.817019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.817296 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.830525 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:02.836487 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:02.837710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.871536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:02.872145 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.872429 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.872693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.873335 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:02.873654 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:02.875419 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:02.887797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1387/2787] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:33:02.892176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:02.902433 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2491-3754-4b38-a635-479742ef7396 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:02.906460 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1401/2788] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:02.907562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:02.908260 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.908530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.908848 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.910105 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:02.912633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:02.916985 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:02.918388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:02.976102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939fc0f-5ace-4a28-a537-5302158729c2 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:02.979836 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:02.980463 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:02.980773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:02.981046 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:02.991221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:02.992698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.002661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1402/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:33:03.112553 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1388/2790] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:02 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:03.113812 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.123652 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ae8ba-7686-4461-a5a0-d2eec68e6f85 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.182348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.182960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.183239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.187547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.187547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.187547 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.289567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1403/2791] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:03 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:03.293804 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.299716 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:03.305637 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492267c-b46a-40a7-9d6b-7395898a3515 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.311137 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.311980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.312262 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.312533 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.313186 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.314998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.326565 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1389/2792] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:03.330601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.341826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102ca9f-00a7-4654-94f1-b0e435a00695 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.347710 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.348378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.348664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.348939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.349592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.351249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.366373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1404/2793] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:03.367603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.379256 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6854-4130-416e-b17b-ec7c12e0d938 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.384410 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.385095 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.385358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.385633 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] PATH_INFO: `/v3/projects/d4571aa7a2694d17816ae4e0356f212c/users/f069f0a144f641ae8078a8e433da942b/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.402017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4571aa7a2694d17816ae4e0356f212c, user_id=f069f0a144f641ae8078a8e433da942b, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.404681 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c363a59-50e1-4634-88bf-a4c2499bc5e2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.541331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.541754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1390/2794] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:03 2022] PUT /identity/v3/projects/d4571aa7a2694d17816ae4e0356f212c/users/f069f0a144f641ae8078a8e433da942b/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:03.544170 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:03.559187 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.559474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.559797 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.567987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06a61-9df3-475d-bb38-303971b5eefd admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.595621 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:03.598090 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] MFA Rules not processed for user `f069f0a144f641ae8078a8e433da942b`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:03.599390 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:03.629199 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.630004 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.630361 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.630639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] PATH_INFO: `/v3/projects/43ee32867d6c438a9dba04a7f2b1af17` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.631850 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ee32867d6c438a9dba04a7f2b1af17)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.633788 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.668481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1391/2795] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:03.673308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.683534 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7cda-6986-4c56-9cd1-441182ba745e None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.688556 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.698118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.698118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.698118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.698118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.698118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.769443 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ee32867d6c438a9dba04a7f2b1af17', 'request_id': 'req-2229882d-5ac5-49ae-9e19-c060a400fb96'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:03.776138 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ee32867d6c438a9dba04a7f2b1af17', 'request_id': 'req-2229882d-5ac5-49ae-9e19-c060a400fb96'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:03.786925 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1392/2796] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:03 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:03.791049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.853808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95b012-fa7f-4a63-90f2-fe62ffa14666 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.858690 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.859296 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.859575 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.859846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.860467 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.863005 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.876207 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ee32867d6c438a9dba04a7f2b1af17', 'request_id': 'req-2229882d-5ac5-49ae-9e19-c060a400fb96'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:03.887962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] The token cache is being invalidate because project 43ee32867d6c438a9dba04a7f2b1af17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:03.890523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:03.890523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:03.890523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1405/2797] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:03 2022] DELETE /identity/v3/projects/43ee32867d6c438a9dba04a7f2b1af17 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:03.894333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.895677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:03.950661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1393/2798] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:03 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:03.954444 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:03.956102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:03.959796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229882d-5ac5-49ae-9e19-c060a400fb96 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.964575 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.965341 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.965667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.966439 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] PATH_INFO: `/v3/users/f28389ff76f24c1390660d657e7a5976` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.967937 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28389ff76f24c1390660d657e7a5976)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.968426 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253e670-ea66-496b-96f8-45e150c4edeb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:03.970045 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.973223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:03.973821 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:03.974140 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:03.974413 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:03.975049 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:03.976621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:03.987718 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1394/2799] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:03.991913 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.001794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765600-10fb-4414-bb89-41b45c8ae922 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.007404 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.010798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.010798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.010798 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] PATH_INFO: `/v3/projects/160f854fe22f4a68accd1921ed815273/users/ccbd841785eb41e2b94609c43c079df8/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.020523 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:04.025500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=160f854fe22f4a68accd1921ed815273, user_id=ccbd841785eb41e2b94609c43c079df8, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.028158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:04.116367 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1395/2800] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:03 2022] PUT /identity/v3/projects/160f854fe22f4a68accd1921ed815273/users/ccbd841785eb41e2b94609c43c079df8/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:04.120100 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.170510 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28389ff76f24c1390660d657e7a5976'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:04.186933 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c5a7e-ee49-4b78-8bf0-8c2d5fe79082 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.192770 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.196378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.196378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.196378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.196378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.196378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:04.209907 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1396/2801] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:04.210971 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.224869 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca400-dc71-4324-902d-fc1ae1ef89d3 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.241640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.241640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.241640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.241640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] PATH_INFO: `/v3/projects/160f854fe22f4a68accd1921ed815273/users/ccbd841785eb41e2b94609c43c079df8/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.242653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=160f854fe22f4a68accd1921ed815273, user_id=ccbd841785eb41e2b94609c43c079df8, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.242653 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d7aed-2b22-4345-999e-922bdfa7c9df admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:04.252924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1397/2802] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:04 2022] PUT /identity/v3/projects/160f854fe22f4a68accd1921ed815273/users/ccbd841785eb41e2b94609c43c079df8/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:04.264477 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28389ff76f24c1390660d657e7a5976'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:04.265457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28389ff76f24c1390660d657e7a5976'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:04.266935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28389ff76f24c1390660d657e7a5976'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:04.275382 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:04.277669 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28389ff76f24c1390660d657e7a5976'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:04.299249 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1406/2803] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:03 2022] DELETE /identity/v3/users/f28389ff76f24c1390660d657e7a5976 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:04.323629 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.323916 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.324192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.354222 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] MFA Rules not processed for user `ccbd841785eb41e2b94609c43c079df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:04.355458 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:04.431069 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1398/2804] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:04.442596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.444235 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:04.505975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d7682-c426-4863-8bb4-2bb28464fb97 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.510102 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.510762 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.511037 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.511307 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.522242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.523770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:04.542936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1407/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:04.689351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.691300 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:04.758784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:04.762791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1b820-1a61-4ad1-acf7-6238afa528bc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.767328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.767950 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.768742 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.769027 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] PATH_INFO: `/v3/users/f069f0a144f641ae8078a8e433da942b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.770184 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f069f0a144f641ae8078a8e433da942b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.772158 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:04.780815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:04.782728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:04.802815 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de418fe-9f6d-4f32-9915-c38b019d592b service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:04.804939 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:04.805580 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:04.805862 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:04.806167 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] PATH_INFO: `/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:04.807329 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba1d36cb9fa4795ba4cc27d56ca0481)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:04.809412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.110249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f069f0a144f641ae8078a8e433da942b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.111432 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba1d36cb9fa4795ba4cc27d56ca0481', 'request_id': 'req-278a36a5-4deb-44ab-924c-996446ac8bf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.118158 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba1d36cb9fa4795ba4cc27d56ca0481', 'request_id': 'req-278a36a5-4deb-44ab-924c-996446ac8bf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.229984 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f069f0a144f641ae8078a8e433da942b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.230648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f069f0a144f641ae8078a8e433da942b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.231383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f069f0a144f641ae8078a8e433da942b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.239227 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-bb066c7f-9a66-4d6b-86e7-3b607d7c2c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f069f0a144f641ae8078a8e433da942b'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.259566 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1399/2806] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:04 2022] DELETE /identity/v3/users/f069f0a144f641ae8078a8e433da942b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:05.263787 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.264073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.264351 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.285993 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:05.287219 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:05.296064 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba1d36cb9fa4795ba4cc27d56ca0481', 'request_id': 'req-278a36a5-4deb-44ab-924c-996446ac8bf7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.309024 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] The token cache is being invalidate because project aba1d36cb9fa4795ba4cc27d56ca0481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:05.309423 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.310927 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-278a36a5-4deb-44ab-924c-996446ac8bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:05.311694 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1408/2807] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:04 2022] DELETE /identity/v3/projects/aba1d36cb9fa4795ba4cc27d56ca0481 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:05.317769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531bdb-c36e-4997-ba19-21254af87cf5 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.318101 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531bdb-c36e-4997-ba19-21254af87cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.318356 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7531bdb-c36e-4997-ba19-21254af87cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.346816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d7531bdb-c36e-4997-ba19-21254af87cf5 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:05.348331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d7531bdb-c36e-4997-ba19-21254af87cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:05.353375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1400/2808] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:05.357450 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1409/2809] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:05.365937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.366783 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.367221 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.367358 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:05.367942 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.390661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:05.392119 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:05.402160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1410/2810] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:05.406609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.417240 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ac827-acf1-4950-8bcd-0e800f9d85f2 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.422257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.422915 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.423198 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.423470 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.424112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:05.424415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.426093 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.432173 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49e41-cef2-4f85-bb90-dac9382728c3 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.435938 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.436536 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.436837 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.437146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.441873 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1411/2811] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 20:33:05.443713 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.450865 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.452499 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.453830 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923083a-226d-49b2-8e4b-8238588da032 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.459425 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.460023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.460303 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.460576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.461193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.463092 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1401/2812] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:05.463333 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.567911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1412/2813] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:05 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:05.572189 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.582277 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a99a0-e7cd-4800-a7df-c660a7f6d807 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.598856 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:05.640204 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.642236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.642236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.642236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.642236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.644237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.773626 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1402/2814] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:05 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:05.777729 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.790386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190723-2f58-4c1a-9801-938f1d44596a admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.795740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.796352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.796796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.796928 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.797923 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.800146 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.811130 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1413/2815] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:05.815129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.826030 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8216-40f9-4fa1-a1f2-b8c3b3012fcf admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.832076 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.832316 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.832602 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.832879 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.833531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.835183 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:05.846171 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1403/2816] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:05.850785 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:05.857522 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:05.860961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9dc42-dae1-404b-8685-bda0ce2bf7d7 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:05.866569 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:05.867219 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:05.867496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:05.867764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] PATH_INFO: `/v3/projects/f9ddff9ee0ea4760bfb3637ac99a625b/users/edfc6961927c4c8c8ed01bbf2e502df7/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:05.882493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ddff9ee0ea4760bfb3637ac99a625b, user_id=edfc6961927c4c8c8ed01bbf2e502df7, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:05.885126 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8330b3d5-ecdf-4108-ab37-e85bdc6cb2a9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:06.008218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1414/2817] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:05 2022] PUT /identity/v3/projects/f9ddff9ee0ea4760bfb3637ac99a625b/users/edfc6961927c4c8c8ed01bbf2e502df7/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:06.009683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:06.012686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:06.020383 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:06.025816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:06.026267 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:06.026475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198215-7e2e-40cc-b892-b0020e9ecf5f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:06.059930 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] MFA Rules not processed for user `edfc6961927c4c8c8ed01bbf2e502df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:06.061229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:06.091230 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:06.092018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:06.092368 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:06.092703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] PATH_INFO: `/v3/projects/d4571aa7a2694d17816ae4e0356f212c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:06.093939 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4571aa7a2694d17816ae4e0356f212c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:06.095875 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:06.129794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1415/2818] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:06.141074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:06.142482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:06.198406 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264bfdc-7908-4eb1-ac37-fd207bdb0cd6 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:06.202082 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:06.202687 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:06.202968 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:06.203233 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:06.211972 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:06.213391 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:06.222869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1416/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:33:06.254242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4571aa7a2694d17816ae4e0356f212c', 'request_id': 'req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.261312 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4571aa7a2694d17816ae4e0356f212c', 'request_id': 'req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.387655 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4571aa7a2694d17816ae4e0356f212c', 'request_id': 'req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.401436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] The token cache is being invalidate because project d4571aa7a2694d17816ae4e0356f212c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:06.402563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.402980 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.404884 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1404/2820] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:06 2022] DELETE /identity/v3/projects/d4571aa7a2694d17816ae4e0356f212c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:06.408943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:06.419872 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd3b1-e63f-4775-a564-25af87d39319 service cinder] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:06.476386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:06.477026 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:06.477308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:06.477579 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] PATH_INFO: `/v3/users/ccbd841785eb41e2b94609c43c079df8` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:06.478745 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbd841785eb41e2b94609c43c079df8)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:06.480660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:06.692165 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:06.708367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbd841785eb41e2b94609c43c079df8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.822530 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbd841785eb41e2b94609c43c079df8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.823108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbd841785eb41e2b94609c43c079df8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.823757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbd841785eb41e2b94609c43c079df8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.832014 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-42aced0d-a7a9-420f-82ed-f411b6ee85c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbd841785eb41e2b94609c43c079df8'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:06.866786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1417/2821] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:06 2022] DELETE /identity/v3/users/ccbd841785eb41e2b94609c43c079df8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:07.360573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:07.363577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:07.380901 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4359a92-d65e-4d5f-99e9-3c042de3cbd8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:07.413521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:07.447727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:07.448386 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:07.448705 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:07.448997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] PATH_INFO: `/v3/projects/160f854fe22f4a68accd1921ed815273` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:07.450640 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=160f854fe22f4a68accd1921ed815273)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:07.453155 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:07.638167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '160f854fe22f4a68accd1921ed815273', 'request_id': 'req-93902c5c-0805-425f-a60a-f4ca530885a2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:07.645135 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '160f854fe22f4a68accd1921ed815273', 'request_id': 'req-93902c5c-0805-425f-a60a-f4ca530885a2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:07.798661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '160f854fe22f4a68accd1921ed815273', 'request_id': 'req-93902c5c-0805-425f-a60a-f4ca530885a2'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:07.810743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] The token cache is being invalidate because project 160f854fe22f4a68accd1921ed815273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:07.811028 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:07.811666 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-93902c5c-0805-425f-a60a-f4ca530885a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:07.813138 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1405/2822] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:07 2022] DELETE /identity/v3/projects/160f854fe22f4a68accd1921ed815273 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:07.818750 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:07.819279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:07.819279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:07.839143 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:07.840350 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:07.902576 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1418/2823] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:07.912308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:07.912308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:07.912308 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:07.938733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:07.939953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:07.948436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1406/2824] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:07.952936 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:07.963092 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1844c6-3a60-41ec-bded-9ab254b4e546 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:07.972740 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:07.973364 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:07.973640 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:07.973943 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:07.974722 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:07.975023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:07.976725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:07.993685 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1419/2825] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:33:07.995072 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.005317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3cc4-3c83-49b0-b980-c86c88005f39 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.010211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.010823 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.011107 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.011378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.012015 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.013959 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.126822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1407/2826] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:07 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:08.131195 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.141622 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01258f9-cce0-4de5-907e-8e61d8c5ccfb admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.201743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.202260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.202534 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.202808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.203454 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.205464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.303695 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1420/2827] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:08 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:08.307857 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.318924 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145860d-cca7-4220-9eb6-ed2d38b9a30a admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.323647 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.324249 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.324524 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.324790 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.325430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.327032 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.338941 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1408/2828] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:08.343306 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.354228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80d54-fe9e-4c88-9279-959763623af3 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.358842 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.359474 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.359784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.360058 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.360702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.362374 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4264d2-e6b6-4ad4-b61c-71a7ecb58783 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.364743 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:08.373561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1421/2829] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:08.377947 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.387919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf6f35-87b7-4208-b880-6beb13c66605 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.392584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.393729 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.394051 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.394322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] PATH_INFO: `/v3/projects/aab7cc4b62c84cabb81f1af1a950ae68/users/d69f718eb41a44d5958c1180e9246ce7/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.409699 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab7cc4b62c84cabb81f1af1a950ae68, user_id=d69f718eb41a44d5958c1180e9246ce7, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.412584 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.527451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1409/2830] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:08 2022] PUT /identity/v3/projects/aab7cc4b62c84cabb81f1af1a950ae68/users/d69f718eb41a44d5958c1180e9246ce7/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:08.539822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.540287 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.540563 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.568048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] MFA Rules not processed for user `d69f718eb41a44d5958c1180e9246ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:08.569272 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:08.634791 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1422/2831] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:08.639303 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.697703 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:08.702845 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c59c3-c2f3-4cc5-a6fd-d3e24dd5ff1d admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.707890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.708491 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.708766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.709035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.709645 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.711561 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:08.826784 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1410/2832] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:08 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:08.830967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:08.841934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e09297-348d-4d2b-9c4b-2f51b00c869e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:08.900431 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:08.901068 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:08.901349 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:08.901620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:08.902290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:08.904213 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:09.007465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1423/2833] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:08 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:09.011476 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:09.022258 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624b1d-7c5a-4ee8-986c-538bbbce7651 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:09.026801 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:09.027391 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.027668 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.027937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.028589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:09.030208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:09.040807 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1411/2834] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:09.045111 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:09.055297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff23be-dd5a-4d90-865b-11769510be54 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:09.059728 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:09.060367 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.060644 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.060921 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] PATH_INFO: `/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a/users/ce40ac1ac28140d5bf231c78a539acb1/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.076677 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dac9fba2f7e4cd48d1be1646e43d74a, user_id=ce40ac1ac28140d5bf231c78a539acb1, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:09.079338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:09.148776 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1424/2835] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:09 2022] PUT /identity/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a/users/ce40ac1ac28140d5bf231c78a539acb1/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:09.152849 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:09.163753 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9047656-7f78-426e-8321-39d74454b646 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:09.228800 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:09.229412 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.229691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.229996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.230639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:09.232237 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379574d-4f73-4a7c-86d0-1f6ee52e747e admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:09.244520 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1412/2836] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:09.248668 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:09.262757 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272e44-b0e0-4014-8633-48e7e24e3286 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:09.270480 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:09.271426 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.271796 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.272137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] PATH_INFO: `/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a/users/ce40ac1ac28140d5bf231c78a539acb1/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.274360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dac9fba2f7e4cd48d1be1646e43d74a, user_id=ce40ac1ac28140d5bf231c78a539acb1, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:09.277204 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:09.291607 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1425/2837] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:09 2022] PUT /identity/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a/users/ce40ac1ac28140d5bf231c78a539acb1/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:09.302513 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.302802 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.303097 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.338259 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] MFA Rules not processed for user `ce40ac1ac28140d5bf231c78a539acb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:09.339979 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:09.428649 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1413/2838] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:09.910960 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:09.912918 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:09.960277 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:09.975975 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bac8-7bca-426a-8488-09e46a1bb7b2 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:09.979568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:09.980232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:09.980660 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:09.980789 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:09.991526 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:09.993044 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc12e1-3de8-4e5f-a0d9-461473af9f88 service cinder] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:10.003545 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1426/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:11.406483 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:11.467677 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:11.480997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2d06c-0d88-46e8-89fd-e0e9dedb0aa4 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:11.488148 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:11.488883 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:11.489248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:11.489515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] PATH_INFO: `/v3/users/d69f718eb41a44d5958c1180e9246ce7` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:11.490670 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69f718eb41a44d5958c1180e9246ce7)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:11.492996 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:11.785642 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69f718eb41a44d5958c1180e9246ce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:11.907516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69f718eb41a44d5958c1180e9246ce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:11.908194 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69f718eb41a44d5958c1180e9246ce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:11.909329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69f718eb41a44d5958c1180e9246ce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:11.917126 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69f718eb41a44d5958c1180e9246ce7'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:11.936964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1414/2840] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:11 2022] DELETE /identity/v3/users/d69f718eb41a44d5958c1180e9246ce7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:11.941531 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:11.945999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:11.945999 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:11.966686 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:11.968389 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:12.037977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1427/2841] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:12.048328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:12.050266 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:12.111125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5885c-ef0e-4de9-ac7f-60b4d736d1a8 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:12.115240 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:12.115855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:12.116159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:12.116430 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:12.125855 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:12.127305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:12.137383 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1415/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:12.647838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:12.647838 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:12.656388 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d923b-82c5-436f-b261-b0562cd96efc None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:12.662602 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:12.663401 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:12.663749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:12.664089 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] PATH_INFO: `/v3/projects/aab7cc4b62c84cabb81f1af1a950ae68` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:12.665390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab7cc4b62c84cabb81f1af1a950ae68)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:12.667561 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:12.883078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab7cc4b62c84cabb81f1af1a950ae68', 'request_id': 'req-4a9a8919-fd98-4125-97a2-43b4de8811fc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:12.889727 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab7cc4b62c84cabb81f1af1a950ae68', 'request_id': 'req-4a9a8919-fd98-4125-97a2-43b4de8811fc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.030775 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab7cc4b62c84cabb81f1af1a950ae68', 'request_id': 'req-4a9a8919-fd98-4125-97a2-43b4de8811fc'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.044193 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] The token cache is being invalidate because project aab7cc4b62c84cabb81f1af1a950ae68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:13.044665 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.045403 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.047747 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1428/2843] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:12 2022] DELETE /identity/v3/projects/aab7cc4b62c84cabb81f1af1a950ae68 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:13.051676 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:13.062018 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee1db2-e3a0-48b0-a0f1-27f2b79f9c75 service neutron] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:13.124661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:13.124661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:13.124661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:13.124661 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] PATH_INFO: `/v3/users/ce40ac1ac28140d5bf231c78a539acb1` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:13.125310 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce40ac1ac28140d5bf231c78a539acb1)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:13.125972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:13.140301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:13.374521 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce40ac1ac28140d5bf231c78a539acb1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.498961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce40ac1ac28140d5bf231c78a539acb1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.499628 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce40ac1ac28140d5bf231c78a539acb1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.500236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce40ac1ac28140d5bf231c78a539acb1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.507791 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-9f159369-c2b6-4132-a09d-01df55c68ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce40ac1ac28140d5bf231c78a539acb1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:13.525972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1416/2844] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:13 2022] DELETE /identity/v3/users/ce40ac1ac28140d5bf231c78a539acb1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:14.029934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.029934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:14.043891 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8919-fd98-4125-97a2-43b4de8811fc admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.115493 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.116288 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.116656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.117188 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] PATH_INFO: `/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.118738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dac9fba2f7e4cd48d1be1646e43d74a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.120784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.133397 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:14.274811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dac9fba2f7e4cd48d1be1646e43d74a', 'request_id': 'req-631872dc-8adc-4f00-be72-03f8bdfd3fcf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:14.282049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dac9fba2f7e4cd48d1be1646e43d74a', 'request_id': 'req-631872dc-8adc-4f00-be72-03f8bdfd3fcf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:14.365154 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dac9fba2f7e4cd48d1be1646e43d74a', 'request_id': 'req-631872dc-8adc-4f00-be72-03f8bdfd3fcf'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:14.376824 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] The token cache is being invalidate because project 6dac9fba2f7e4cd48d1be1646e43d74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:14.377239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:14.388605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-631872dc-8adc-4f00-be72-03f8bdfd3fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:14.388605 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1429/2845] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:14 2022] DELETE /identity/v3/projects/6dac9fba2f7e4cd48d1be1646e43d74a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:14.389162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.389162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.389162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.408278 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:14.409662 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:14.479317 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1417/2846] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:14.488086 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.488671 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.489104 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.513553 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:14.515051 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:14.528770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1430/2847] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:14.528908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.544912 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c984f98-cb69-473d-864e-04048e48dfc2 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.555132 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.558029 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.558333 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.558604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.559263 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81921) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:14.559562 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.561292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.574886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1418/2848] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:33:14.579205 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.589176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbacf-56da-46f3-9442-858894e0f367 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.594325 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.594934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.601001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.601001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.601001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.601001 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.720833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1431/2849] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:14 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:14.726548 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.737560 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aba4a-21cc-4c5e-b9d0-011557cc3354 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.797890 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.798439 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.798719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.798989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.800257 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.802505 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.929131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1419/2850] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:14 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:14.933701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.944721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db494-3cd2-49fc-9475-e44b4965cd11 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.949656 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.950577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.950577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.950926 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.951447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.953040 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.963703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1432/2851] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:14.968197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:14.979323 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2e80b-6baf-4b39-9cbc-179d93789f2b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:14.984108 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:14.989471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:14.989471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:14.989471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:14.989471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:14.989471 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7f518-0151-4b28-9599-4f1e6bf11c62 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:14.992217 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:15.012643 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1420/2852] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:15.017769 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.031980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5167a-061f-4df4-a020-57cc70e153ae admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.037949 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.038746 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.039263 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.039828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] PATH_INFO: `/v3/projects/ff4c032147be489ab88a76da9560c237/users/4a6bc5aec2cc4459bcd118ee021c4974/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.063971 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4c032147be489ab88a76da9560c237, user_id=4a6bc5aec2cc4459bcd118ee021c4974, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.067407 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.174197 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1433/2853] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:15 2022] PUT /identity/v3/projects/ff4c032147be489ab88a76da9560c237/users/4a6bc5aec2cc4459bcd118ee021c4974/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:15.189691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.190131 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.190479 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.221016 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] MFA Rules not processed for user `4a6bc5aec2cc4459bcd118ee021c4974`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:15.223485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:15.297331 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1421/2854] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:15.302402 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.379822 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d790d9-1fa2-4988-800e-c264e5afb58e admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.385021 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.385639 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.385961 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.386216 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.386849 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.388749 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.491330 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1434/2855] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:15 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:15.495059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.509475 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c5197-32c1-4f8d-b7cd-6456f5e28dcc None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.573702 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.574329 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.574537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.574818 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.582678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.582678 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.699094 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1422/2856] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:15 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:15.706105 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.717832 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101886-075e-45ef-8dc3-d895f8be80d5 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.723948 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.724564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.724839 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.725108 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.725833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.727491 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.741091 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1435/2857] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:15.745375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.756589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47f638-e020-42ff-a594-8bbcd091f859 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.761469 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.762102 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.762381 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.762648 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] PATH_INFO: `/v3/projects/c35f3480a6974d23b408240a4691519c/users/051624e4af5446788f07ef415889002e/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.779858 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35f3480a6974d23b408240a4691519c, user_id=051624e4af5446788f07ef415889002e, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.782589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.855118 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1423/2858] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:15 2022] PUT /identity/v3/projects/c35f3480a6974d23b408240a4691519c/users/051624e4af5446788f07ef415889002e/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:15.863978 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.874731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099acc97-31bb-4018-b815-d096cb5c7cc0 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.878732 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:15.937594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.938415 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.944085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.944085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.944085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.944085 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83acfa-21c8-4d25-8a9b-edcaf5d66090 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.953094 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1436/2859] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:15.958129 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:15.969401 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124091-f4ab-4947-840c-ba50d0cedc44 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:15.975322 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:15.976013 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:15.976291 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:15.978343 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] PATH_INFO: `/v3/projects/c35f3480a6974d23b408240a4691519c/users/051624e4af5446788f07ef415889002e/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:15.978610 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35f3480a6974d23b408240a4691519c, user_id=051624e4af5446788f07ef415889002e, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:15.981357 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:15.993264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1424/2860] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:15 2022] PUT /identity/v3/projects/c35f3480a6974d23b408240a4691519c/users/051624e4af5446788f07ef415889002e/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:16.004701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:16.004998 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:16.005270 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:16.034257 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] MFA Rules not processed for user `051624e4af5446788f07ef415889002e`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:16.035664 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:16.114290 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1437/2861] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:16.133289 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:16.135327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:16.196962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:16.215701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c18616-6232-4a24-a382-1cd6e75b7d84 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:16.219675 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:16.220396 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:16.220736 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:16.221679 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:16.232216 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:16.233691 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca3c2d-b055-41a6-8f61-091bde7a75e7 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:16.246290 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1425/2862] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:16.961405 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:17.027951 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eb38b-a3d8-4d36-ab9f-9b3ec27edcbb None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:17.032770 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:17.033442 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:17.034228 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:17.034519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] PATH_INFO: `/v3/users/4a6bc5aec2cc4459bcd118ee021c4974` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:17.035707 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6bc5aec2cc4459bcd118ee021c4974)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:17.039337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:17.271440 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:17.286098 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6bc5aec2cc4459bcd118ee021c4974'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:17.400396 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6bc5aec2cc4459bcd118ee021c4974'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:17.401564 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6bc5aec2cc4459bcd118ee021c4974'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:17.402698 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6bc5aec2cc4459bcd118ee021c4974'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:17.412031 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6bc5aec2cc4459bcd118ee021c4974'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:17.431909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1438/2863] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:16 2022] DELETE /identity/v3/users/4a6bc5aec2cc4459bcd118ee021c4974 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:17.436609 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:17.437146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:17.437146 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:17.462236 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:17.463366 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:17.527494 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1426/2864] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:17.539828 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:17.541314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:17.617301 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaaada-dd1c-4952-aaa5-184abab0f762 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:17.621122 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:17.621738 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:17.622049 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:17.622318 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:17.637232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:17.637232 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:17.648831 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1439/2865] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:18.215604 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:18.226617 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:18.229829 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefe4fb-89cc-4182-a133-153e31cff099 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:18.234732 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:18.235306 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:18.235583 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:18.235852 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] PATH_INFO: `/v3/projects/ff4c032147be489ab88a76da9560c237` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:18.237564 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4c032147be489ab88a76da9560c237)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:18.239733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:18.429644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4c032147be489ab88a76da9560c237', 'request_id': 'req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.437293 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4c032147be489ab88a76da9560c237', 'request_id': 'req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.542255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4c032147be489ab88a76da9560c237', 'request_id': 'req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.555860 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] The token cache is being invalidate because project ff4c032147be489ab88a76da9560c237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:18.556159 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.556897 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.558462 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1427/2866] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:18 2022] DELETE /identity/v3/projects/ff4c032147be489ab88a76da9560c237 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:18.562794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:18.573323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22733da-3ffc-462b-b8b0-80dcc611fcdb service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:18.632667 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:18.633310 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:18.633592 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:18.633869 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] PATH_INFO: `/v3/users/051624e4af5446788f07ef415889002e` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:18.635048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051624e4af5446788f07ef415889002e)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:18.636977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:18.907624 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051624e4af5446788f07ef415889002e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:18.912103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:19.016300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051624e4af5446788f07ef415889002e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.019505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051624e4af5446788f07ef415889002e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.019505 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051624e4af5446788f07ef415889002e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.026606 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-dd90df17-4cc8-4256-99c9-2c883e3a6846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051624e4af5446788f07ef415889002e'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.045331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1440/2867] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:18 2022] DELETE /identity/v3/users/051624e4af5446788f07ef415889002e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:19.500370 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:19.503055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:19.516324 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68b33b-050e-4e43-b3b2-91d7daee1ebb admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:19.576928 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:19.577586 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:19.577871 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:19.578176 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] PATH_INFO: `/v3/projects/c35f3480a6974d23b408240a4691519c` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:19.579305 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35f3480a6974d23b408240a4691519c)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:19.581822 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:19.590156 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:19.702059 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35f3480a6974d23b408240a4691519c', 'request_id': 'req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.709942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35f3480a6974d23b408240a4691519c', 'request_id': 'req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.804639 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35f3480a6974d23b408240a4691519c', 'request_id': 'req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.816149 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] The token cache is being invalidate because project c35f3480a6974d23b408240a4691519c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:19.816436 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.817080 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-666e305b-d174-4e9d-ab47-c65b8fb3a0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:19.818644 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1428/2868] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:19 2022] DELETE /identity/v3/projects/c35f3480a6974d23b408240a4691519c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:19.823647 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:19.824176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:19.824176 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:19.844398 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:19.845608 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:19.912253 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1441/2869] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:19.921422 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:19.921775 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:19.929205 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:19.943811 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:19.945035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:19.954207 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1429/2870] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:19.959444 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:19.969676 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb71ba-b587-46f8-a119-c552c42bea1e None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:19.974633 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:19.975242 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:19.975524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:19.975794 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:19.976486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:19.976793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:19.978503 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:19.991218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1442/2871] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:33:19.995573 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.005621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d5926-7a7d-472e-ad91-beea630bb1ed None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.010392 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.010989 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.011272 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.011543 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.012169 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.014115 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.143908 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1430/2872] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:19 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:20.146748 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.156786 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004405b-0b1a-4382-bb55-e1e7b8444ab9 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.222057 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.222679 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.222955 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.223225 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.223871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.225784 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.333990 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1443/2873] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:20 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:20.338223 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.349463 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60124b4-9ebb-4984-8997-936c992ada89 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.354037 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.354631 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.355309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.355309 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.355786 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.357369 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.368221 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1431/2874] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:20.372276 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.383260 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff6afe-ba80-4270-9ce3-8d5a0451e656 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.388180 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.388777 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.389055 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.389323 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.390036 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.391627 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1257ed7-4054-496f-9875-f3bdff3a3866 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.403609 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1444/2875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:20.407975 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.418527 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30323aed-4050-47c2-9e35-2e76bac8fbde admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.423175 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.423843 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.424693 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.424942 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] PATH_INFO: `/v3/projects/4de3e975e235469eab3b5e214a22f849/users/8a420f5de6db416a86d350e0b8025d27/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.439540 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de3e975e235469eab3b5e214a22f849, user_id=8a420f5de6db416a86d350e0b8025d27, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.442460 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.635763 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1432/2876] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:20 2022] PUT /identity/v3/projects/4de3e975e235469eab3b5e214a22f849/users/8a420f5de6db416a86d350e0b8025d27/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:20.646651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.646940 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.647297 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.676338 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] MFA Rules not processed for user `8a420f5de6db416a86d350e0b8025d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:20.682816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:20.700861 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:20.742959 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1445/2877] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:20.747591 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.810672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c0f9-e14a-4d94-abb5-028d138d80a9 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.815593 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.816250 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.816500 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.816774 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.817509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.819577 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.936962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.938765 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:20.953787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c953df-e993-4080-8b5b-b6150010eeca None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:20.960048 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:20.960818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:20.961113 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:20.961486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] PATH_INFO: `/v3/users/edfc6961927c4c8c8ed01bbf2e502df7` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:20.966061 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1433/2878] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:20 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:20.966414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfc6961927c4c8c8ed01bbf2e502df7)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:20.966414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:20.967672 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:20.999558 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:21.042197 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff170c6-0817-4ee0-9df2-2c2d2e8b79b0 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.047119 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.047737 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.052808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.052808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] PATH_INFO: `/v3/users` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.052808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.052808 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.167199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1434/2879] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:20 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:21.171179 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.181098 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a404875-01cd-494a-9220-2e0037a4f23f admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.185956 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.186545 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.186827 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.187103 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.187785 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.189389 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.201228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1435/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 20:33:21.206537 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.209331 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfc6961927c4c8c8ed01bbf2e502df7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:21.219484 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4d882-9ee2-4110-b1d6-5635b0334adf admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.225035 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.225684 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.225997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.226275 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] PATH_INFO: `/v3/projects/1f732f1576f64fc19b4411ba1b343682/users/342c571d4bec4ac588cc996675b5097d/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.240846 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f732f1576f64fc19b4411ba1b343682, user_id=342c571d4bec4ac588cc996675b5097d, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.243539 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.307360 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfc6961927c4c8c8ed01bbf2e502df7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:21.307974 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfc6961927c4c8c8ed01bbf2e502df7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:21.308577 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfc6961927c4c8c8ed01bbf2e502df7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:21.316390 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-cdcb6f1f-d396-4cd0-8236-a105e4742f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfc6961927c4c8c8ed01bbf2e502df7'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:21.334218 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1446/2881] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:20 2022] DELETE /identity/v3/users/edfc6961927c4c8c8ed01bbf2e502df7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:21.338461 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.338744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.339011 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.350862 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1436/2882] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:21 2022] PUT /identity/v3/projects/1f732f1576f64fc19b4411ba1b343682/users/342c571d4bec4ac588cc996675b5097d/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:21.354826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.356481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.358723 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:21.359894 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.427027 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1447/2883] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:21.427242 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7110727-e45c-4162-9b3f-4fb6c475810b admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.431474 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.432192 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.432488 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.432740 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.433397 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.434986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.435106 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.437025 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.446813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1437/2884] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:21.451026 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.461603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62eb32-6d50-482d-ba81-528e671d19b7 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.466957 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.467682 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.467961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.468232 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] PATH_INFO: `/v3/projects/1f732f1576f64fc19b4411ba1b343682/users/342c571d4bec4ac588cc996675b5097d/roles/a1c119f687024f64a94dba8ff8849b9b` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.470172 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f732f1576f64fc19b4411ba1b343682, user_id=342c571d4bec4ac588cc996675b5097d, role_id=a1c119f687024f64a94dba8ff8849b9b)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.473133 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a8256-5f62-4979-85a1-eeae3607f16c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.485150 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1438/2885] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:21 2022] PUT /identity/v3/projects/1f732f1576f64fc19b4411ba1b343682/users/342c571d4bec4ac588cc996675b5097d/roles/a1c119f687024f64a94dba8ff8849b9b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 20:33:21.490053 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:21.495598 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.495886 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.496167 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.506239 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a52e7a-0b74-482d-8d4c-c5b89c8e7906 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.526603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] MFA Rules not processed for user `342c571d4bec4ac588cc996675b5097d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:21.527923 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.558414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.559381 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.559773 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.560258 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.573125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:21.602882 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1439/2886] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 20:33:21.615382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:21.616977 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.635168 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.636658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.651648 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1448/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:33:21.692588 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd364fc-5374-44d0-bf81-b79974ec0492 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:21.696334 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:21.697043 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:21.697328 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:21.697600 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:21.699618 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:21.776758 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:21.778239 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:21.787847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1440/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 20:33:22.227352 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:22.234088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:22.252308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086412ed-62ed-476e-b42b-f87be95af0d0 service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:22.261457 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:22.262151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:22.262435 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:22.264871 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] PATH_INFO: `/v3/projects/f9ddff9ee0ea4760bfb3637ac99a625b` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:22.266206 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ddff9ee0ea4760bfb3637ac99a625b)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:22.268115 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:22.470476 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ddff9ee0ea4760bfb3637ac99a625b', 'request_id': 'req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:22.479337 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ddff9ee0ea4760bfb3637ac99a625b', 'request_id': 'req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:22.601413 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ddff9ee0ea4760bfb3637ac99a625b', 'request_id': 'req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:22.613524 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] The token cache is being invalidate because project f9ddff9ee0ea4760bfb3637ac99a625b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:22.613816 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:22.614498 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:22.615991 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1449/2889] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:22 2022] DELETE /identity/v3/projects/f9ddff9ee0ea4760bfb3637ac99a625b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:29.537495 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:29.538919 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:29.550613 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496c200-3c2c-4164-a3dc-6dbbf41304ff service cinder] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:29.605330 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:29.605964 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:29.606241 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:29.606516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:29.608297 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:29.657868 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=100 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:29.677454 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:29.678937 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1852b97-aa56-41f2-8be2-5e223da2d0d6 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:29.688551 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1441/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:32.609818 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:36.978711 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:36.980192 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:37.043324 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870f7a2-edcb-4af8-9b66-3a6d4264ad17 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:37.047833 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:37.048458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:37.048980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:37.048980 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] PATH_INFO: `/v3/users/8a420f5de6db416a86d350e0b8025d27` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:37.050601 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a420f5de6db416a86d350e0b8025d27)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:37.052449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:37.312516 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a420f5de6db416a86d350e0b8025d27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:37.398721 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a420f5de6db416a86d350e0b8025d27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:37.399354 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a420f5de6db416a86d350e0b8025d27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:37.399962 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a420f5de6db416a86d350e0b8025d27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:37.407899 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a420f5de6db416a86d350e0b8025d27'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:37.428171 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1450/2891] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:36 2022] DELETE /identity/v3/users/8a420f5de6db416a86d350e0b8025d27 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:37.432922 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:37.433425 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:37.433531 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:37.452728 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:37.453972 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:37.513686 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1442/2892] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:37.524670 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:37.526120 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:37.586486 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf6b18-1ed8-447d-9bf7-76e1185e7e30 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:37.590088 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:37.590967 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:37.591245 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:37.591519 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:37.601326 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:37.602793 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:37.612348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1451/2893] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:38.110603 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:38.112245 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:38.124961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62ec19-1932-430d-a5f0-a11f26c14458 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:38.131078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:38.131755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:38.132033 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:38.132311 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] PATH_INFO: `/v3/projects/4de3e975e235469eab3b5e214a22f849` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:38.133480 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de3e975e235469eab3b5e214a22f849)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:38.135452 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:38.311073 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de3e975e235469eab3b5e214a22f849', 'request_id': 'req-d2524903-f77b-4a15-88dc-889487ad5275'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:38.319589 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de3e975e235469eab3b5e214a22f849', 'request_id': 'req-d2524903-f77b-4a15-88dc-889487ad5275'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:38.578295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de3e975e235469eab3b5e214a22f849', 'request_id': 'req-d2524903-f77b-4a15-88dc-889487ad5275'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:38.589961 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] The token cache is being invalidate because project 4de3e975e235469eab3b5e214a22f849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:38.590360 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:38.591326 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:38.592850 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1443/2894] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:38 2022] DELETE /identity/v3/projects/4de3e975e235469eab3b5e214a22f849 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:38.597112 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:38.608701 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426675d-382c-4120-875e-04a0159c301e service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:38.628661 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:38.667932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:38.668567 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:38.668986 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:38.669289 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] PATH_INFO: `/v3/users/342c571d4bec4ac588cc996675b5097d` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:38.670464 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=342c571d4bec4ac588cc996675b5097d)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:38.672412 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:38.937279 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342c571d4bec4ac588cc996675b5097d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.000909 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342c571d4bec4ac588cc996675b5097d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.001600 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342c571d4bec4ac588cc996675b5097d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.002372 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342c571d4bec4ac588cc996675b5097d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.010159 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342c571d4bec4ac588cc996675b5097d'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.028764 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1452/2895] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:38 2022] DELETE /identity/v3/users/342c571d4bec4ac588cc996675b5097d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:39.473141 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:39.474874 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:39.490927 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2524903-f77b-4a15-88dc-889487ad5275 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:39.555125 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:39.555779 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:39.556055 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:39.556327 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] PATH_INFO: `/v3/projects/1f732f1576f64fc19b4411ba1b343682` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:39.557722 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f732f1576f64fc19b4411ba1b343682)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:39.559754 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:39.571962 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:39.688011 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f732f1576f64fc19b4411ba1b343682', 'request_id': 'req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.694794 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f732f1576f64fc19b4411ba1b343682', 'request_id': 'req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.827664 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f732f1576f64fc19b4411ba1b343682', 'request_id': 'req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.839987 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] The token cache is being invalidate because project 1f732f1576f64fc19b4411ba1b343682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:39.841261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.841261 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-e89671cc-c9f3-4ca6-a89e-4fb1cc683678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:39.842727 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1444/2896] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:39 2022] DELETE /identity/v3/projects/1f732f1576f64fc19b4411ba1b343682 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:46.187527 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:46.189758 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:46.203125 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362119f-4251-4b29-ac11-dbfaf928bd40 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:46.260790 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:46.261445 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:46.261730 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:46.262042 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] PATH_INFO: `/v3/users/851e3d9f3c32458f97d4583c03c453e2` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:46.263378 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] RBAC: Authorizing `identity:delete_user(user_id=851e3d9f3c32458f97d4583c03c453e2)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:46.265314 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:46.519482 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:46.521703 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851e3d9f3c32458f97d4583c03c453e2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:46.640853 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851e3d9f3c32458f97d4583c03c453e2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:46.641571 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851e3d9f3c32458f97d4583c03c453e2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:46.642229 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851e3d9f3c32458f97d4583c03c453e2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:46.650811 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851e3d9f3c32458f97d4583c03c453e2'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:46.672386 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1453/2897] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:46 2022] DELETE /identity/v3/users/851e3d9f3c32458f97d4583c03c453e2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:46.677721 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:46.678292 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:46.678522 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:46.698516 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:46.699766 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:46.765567 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1445/2898] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:46.775447 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:46.776808 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:46.835019 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd4c61-a568-4b5d-b2ea-5f3fab64434f admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:46.838626 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:46.842731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:46.842731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:46.842731 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:46.849827 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:46.851340 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154b4be-d70c-437f-b402-3d9329af11e4 service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:46.861596 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1454/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:47.270091 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:47.271704 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:47.284997 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b1c79-9ea5-40ed-8d1c-1967487ee693 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:47.289780 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:47.290451 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.290885 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.291162 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] PATH_INFO: `/v3/projects/534984c650c94425a0a6c03e9c710bdc` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.292288 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=534984c650c94425a0a6c03e9c710bdc)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:47.294228 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:47.425364 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534984c650c94425a0a6c03e9c710bdc', 'request_id': 'req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:47.431772 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534984c650c94425a0a6c03e9c710bdc', 'request_id': 'req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:47.519382 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534984c650c94425a0a6c03e9c710bdc', 'request_id': 'req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:47.531203 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] The token cache is being invalidate because project 534984c650c94425a0a6c03e9c710bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:47.531487 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:47.532157 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-f9c7a1e8-a615-44b0-8eae-9d1e4fe229cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:47.534301 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1446/2900] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:47 2022] DELETE /identity/v3/projects/534984c650c94425a0a6c03e9c710bdc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:47.539200 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.539702 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.539820 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.559458 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:47.560594 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:47.621023 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1455/2901] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:47.634065 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.634352 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.634627 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.655378 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:47.656605 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:47.665208 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1447/2902] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:47.670147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:47.680160 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be822f4-6850-4787-a78c-a5dabdf700e3 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:47.684852 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:47.687857 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.688137 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.691103 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.693932 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 20:33:47.694244 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:47.695848 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:47.709925 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1456/2903] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 17 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 20:33:47.712911 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:47.722743 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b1db-1392-4013-adca-c72fba5009f0 None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:47.727415 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:47.728020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.728295 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.728563 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.729181 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:47.731121 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:47.747720 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:47.861416 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1448/2904] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 17 20:33:47 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 20:33:47.866107 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:47.877568 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fba52-a109-4b7b-8c44-498b5a5b52ad admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:47.927581 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:47.938465 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:47.939620 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:47.939887 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:47.940151 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] PATH_INFO: `/v3/users` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:47.940913 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:47.942934 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.041554 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1457/2905] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 17 20:33:47 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 20:33:48.045755 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:48.057733 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef51a11-9cd4-48bd-8c08-4db2cc588e8c admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:48.062934 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:48.063544 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.063813 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.064152 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.065196 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:48.066853 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.077432 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1449/2906] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:48.082123 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:48.093078 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b56769-7ec7-4d7f-b980-04e581d7f6de admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:48.098911 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:48.099523 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.099803 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.100070 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] PATH_INFO: `/v3/roles` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.100725 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:48.102496 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f66c6-35f7-469f-83c0-e1c7b1bb748d admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.114573 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1458/2907] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 17 20:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 20:33:48.123601 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:48.132255 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20991629-95b8-423e-ba3b-caaf820d0b36 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:48.137024 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:48.137683 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.137995 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.138264 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] PATH_INFO: `/v3/projects/b3537f460ad14a39814be6526fa62366/users/5f3ef15734454618a48dd95a4276d070/roles/f25e512661f54369b009eabe1c62d99a` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.155211 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3537f460ad14a39814be6526fa62366, user_id=5f3ef15734454618a48dd95a4276d070, role_id=f25e512661f54369b009eabe1c62d99a)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:48.158622 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.229717 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1450/2908] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 17 20:33:48 2022] PUT /identity/v3/projects/b3537f460ad14a39814be6526fa62366/users/5f3ef15734454618a48dd95a4276d070/roles/f25e512661f54369b009eabe1c62d99a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:48.296469 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] REQUEST_METHOD: `POST` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.296744 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.297020 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.325449 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.auth.core [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] MFA Rules not processed for user `5f3ef15734454618a48dd95a4276d070`. Rule list: `[]` (Enabled: `True`). {{(pid=81920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:48.326866 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:48.395348 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1459/2909] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:48.407012 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:48.409485 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:48.469199 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedac022-f56b-4d02-85d9-2e9f16db86d1 admin admin] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:48.473782 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af188d89b2fe416884b5f80ff25b8d45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:48.474420 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] REQUEST_METHOD: `GET` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.474701 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.474973 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.483528 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:48.484945 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cf899-566a-4b62-a876-a15a7efe6113 service cinder] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.494719 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1451/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:48.520787 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:48.586074 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d6371-9ab2-46be-b81e-c363175afb78 None None] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:48.591016 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:48.591653 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.591935 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.592210 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] PATH_INFO: `/v3/users/5f3ef15734454618a48dd95a4276d070` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.593365 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3ef15734454618a48dd95a4276d070)` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:48.595385 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:48.801651 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3ef15734454618a48dd95a4276d070'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:48.878658 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3ef15734454618a48dd95a4276d070'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:48.879300 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3ef15734454618a48dd95a4276d070'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:48.879929 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3ef15734454618a48dd95a4276d070'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:48.885649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:48.887635 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.notifications [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3ef15734454618a48dd95a4276d070'} {{(pid=81920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:48.904826 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1460/2911] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 17 20:33:48 2022] DELETE /identity/v3/users/5f3ef15734454618a48dd95a4276d070 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:48.909847 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] REQUEST_METHOD: `POST` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:48.910385 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:48.910515 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:48.929953 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.auth.core [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] MFA Rules not processed for user `33f3999b36d7469f8f3b2c27f834129d`. Rule list: `[]` (Enabled: `True`). {{(pid=81921) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 20:33:48.931170 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:48.990168 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1452/2912] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 17 20:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 20:33:48.999987 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:49.002414 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:49.064675 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f3e0f-bbd7-4db2-9ac5-f7208ca960b4 admin admin] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:49.068373 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '880635427a704e0e8107da0a07088237', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:49.068977 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:49.069251 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:49.069518 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:49.078717 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:49.080778 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:49.090339 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1461/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:33:49.498017 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] Authenticating user token {{(pid=81921) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:33:49.499509 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.fernet_utils [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81921) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:33:49.511940 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21e159-c1d2-40dd-9554-f48344e7ad9f None None] Validating token access rules against request {{(pid=81921) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:33:49.516771 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f3999b36d7469f8f3b2c27f834129d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cdb00bd40c94bdca97e51936bedf565', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81921) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:33:49.518078 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:33:49.518375 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:33:49.518621 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] PATH_INFO: `/v3/projects/b3537f460ad14a39814be6526fa62366` {{(pid=81921) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:33:49.520248 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3537f460ad14a39814be6526fa62366)` {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:33:49.521998 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] RBAC: Authorization granted {{(pid=81921) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:33:49.662530 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3537f460ad14a39814be6526fa62366', 'request_id': 'req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:49.668638 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3537f460ad14a39814be6526fa62366', 'request_id': 'req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:49.671166 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:49.749982 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3537f460ad14a39814be6526fa62366', 'request_id': 'req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9'} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:49.761481 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] The token cache is being invalidate because project b3537f460ad14a39814be6526fa62366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81921) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 20:33:49.762282 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:49.762510 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG keystone.notifications [None req-81d7e4ed-7266-49a6-bca1-eb8700c19cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81921) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 20:33:49.764020 dv-cinder-820027-19-smb devstack@keystone.service[81921]: [pid: 81921|app: 0|req: 1453/2914] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 17 20:33:49 2022] DELETE /identity/v3/projects/b3537f460ad14a39814be6526fa62366 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 20:33:59.085945 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=34,keystone:DELETE=2 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:34:00.089826 dv-cinder-820027-19-smb devstack@keystone.service[81921]: DEBUG dbcounter [-] [81921] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=81921) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:35.916521 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] Authenticating user token {{(pid=81920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 20:35:35.917983 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:35.989908 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a534c-54a7-415f-83f0-f56710f7a22c service neutron] Validating token access rules against request {{(pid=81920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 20:35:36.050147 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f4767886144473e95c3f3998461bd2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f86ce3fe6d649e59db94f90679f6101', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 20:35:36.050768 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] REQUEST_METHOD: `GET` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 20:35:36.051050 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] SCRIPT_NAME: `/identity` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 20:35:36.051322 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 20:35:36.053075 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.fernet_utils [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 20:35:36.065308 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 20:35:36.066916 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cd84d-18b3-47fc-a0e5-02cfcf77c1db service placement] RBAC: Authorization granted {{(pid=81920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 20:35:36.076895 dv-cinder-820027-19-smb devstack@keystone.service[81920]: [pid: 81920|app: 0|req: 1462/2915] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 17 20:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 20:35:46.072649 dv-cinder-820027-19-smb devstack@keystone.service[81920]: DEBUG dbcounter [-] [81920] Writing DB stats keystone:SELECT=58 {{(pid=81920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}